Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A common misapplication of statistical inference: nuisance control with
  null-hypothesis significance tests   Experimental research on behavior and cognition frequently rests on stimulus
or subject selection where not all characteristics can be fully controlled,
even when attempting strict matching. For example, when contrasting patients to
controls, variables such as intelligence or socioeconomic status are often
correlated with patient status. Similarly, when presenting word stimuli,
variables such as word frequency are often correlated with primary variables of
interest. One procedure very commonly employed to control for such nuisance
effects is conducting inferential tests on confounding stimulus or subject
characteristics. For example, if word length is not significantly different for
two stimulus sets, they are considered as matched for word length. Such a test
has high error rates and is conceptually misguided. It reflects a common
misunderstanding of statistical tests: interpreting significance not to refer
to inference about a particular population parameter, but about 1. the sample
in question, 2. the practical relevance of a sample difference (so that a
nonsignificant test is taken to indicate evidence for the absence of relevant
differences). We show inferential testing for assessing nuisance effects to be
inappropriate both pragmatically and philosophically, present a survey showing
its high prevalence, and briefly discuss an alternative in the form of
regression including nuisance variables.

11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
1
The categories of this paper are: cs
2
The categories of this paper are: math
19
The categories of this paper are: eess