Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Top-$k$ Regularization for Supervised Feature Selection   Feature selection identifies subsets of informative features and reduces
dimensions in the original feature space, helping provide insights into data
generation or a variety of domain problems. Existing methods mainly depend on
feature scoring functions or sparse regularizations; nonetheless, they have
limited ability to reconcile the representativeness and inter-correlations of
features. In this paper, we introduce a novel, simple yet effective
regularization approach, named top-$k$ regularization, to supervised feature
selection in regression and classification tasks. Structurally, the top-$k$
regularization induces a sub-architecture on the architecture of a learning
model to boost its ability to select the most informative features and model
complex nonlinear relationships simultaneously. Theoretically, we derive and
mathematically prove a uniform approximation error bound for using this
approach to approximate high-dimensional sparse functions. Extensive
experiments on a wide variety of benchmarking datasets show that the top-$k$
regularization is effective and stable for supervised feature selection.

15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
7
The categories of this paper are: hep-th
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org