Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: How Well Do My Results Generalize Now? The External Validity of Online
  Privacy and Security Surveys   Security and privacy researchers often rely on data collected through online
crowdsourcing platforms such as Amazon Mechanical Turk (MTurk) and Prolific.
Prior work -- which used data collected in the United States between 2013 and
2017 -- found that MTurk responses regarding security and privacy were
generally representative for people under 50 or with some college education.
However, the landscape of online crowdsourcing has changed significantly over
the last five years, with the rise of Prolific as a major platform and the
increasing presence of bots. This work attempts to replicate the prior results
about the external validity of online privacy and security surveys. We conduct
an online survey on MTurk (n=800), a gender-balanced survey on Prolific
(n=800), and a representative survey on Prolific (n=800) and compare the
responses to a probabilistic survey conducted by the Pew Research Center
(n=4272). We find that MTurk responses are no longer representative of the U.S.
population, even when responses that fail attention check questions or CAPTCHAs
are excluded. Data collected through Prolific is generally representative for
questions about user perceptions and experience, but not for questions about
security and privacy knowledge. We also evaluate the impact of Prolific
settings (e.g., gender-balanced sample vs. representative sample), various
attention check questions, and statistical methods on the external validity of
surveys conducted through Prolific, and we develop recommendations about best
practices for conducting online privacy and security surveys.

12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom