Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Identification of Signal, Noise, and Indistinguishable Subsets in
  High-Dimensional Data Analysis   Motivated by applications in high-dimensional data analysis where strong
signals often stand out easily and weak ones may be indistinguishable from the
noise, we develop a statistical framework to provide a novel categorization of
the data into the signal, noise, and indistinguishable subsets. The
three-subset categorization is especially relevant under high-dimensionality as
a large proportion of signals can be obscured by the large amount of noise.
Understanding the three-subset phenomenon is important for the researchers in
real applications to design efficient follow-up studies. %For example,
candidates belonging to the signal subset may have priority for more focused
study, while those in the noise subset can be removed; and, for candidates in
the indistinguishable subset, additional data may be collected to further
separate weak signals from the noise. We develop an efficient data-driven
procedure to identify the three subsets. Theoretical study shows that, under
certain conditions, only signals are included in the identified signal subset
while the remaining signals are included in the identified indistinguishable
subsets with high probability. Moreover, the proposed procedure adapts to the
unknown signal intensity, so that the identified indistinguishable subset
shrinks with the true indistinguishable subset when signals become stronger.
The procedure is examined and compared with methods based on FDR control using
Monte Carlo simulation. Further, it is applied successfully in a real-data
application to identify genomic variants having different signal intensity.

34
The categories of this paper are: chem-ph
19
The categories of this paper are: eess
1
The categories of this paper are: cs
37
The categories of this paper are: supr-con
35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an