Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PPFS: Predictive Permutation Feature Selection   We propose Predictive Permutation Feature Selection (PPFS), a novel
wrapper-based feature selection method based on the concept of Markov Blanket
(MB). Unlike previous MB methods, PPFS is a universal feature selection
technique as it can work for both classification as well as regression tasks on
datasets containing categorical and/or continuous features. We propose
Predictive Permutation Independence (PPI), a new Conditional Independence (CI)
test, which enables PPFS to be categorised as a wrapper feature selection
method. This is in contrast to current filter based MB feature selection
techniques that are unable to harness the advancements in supervised algorithms
such as Gradient Boosting Machines (GBM). The PPI test is based on the knockoff
framework and utilizes supervised algorithms to measure the association between
an individual or a set of features and the target variable. We also propose a
novel MB aggregation step that addresses the issue of sample inefficiency.
Empirical evaluations and comparisons on a large number of datasets demonstrate
that PPFS outperforms state-of-the-art Markov blanket discovery algorithms as
well as, well-known wrapper methods. We also provide a sketch of the proof of
correctness of our method. Implementation of this work is available at
\url{https://github.com/atif-hassan/PyImpetus}

3
The categories of this paper are: physics
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
18
The categories of this paper are: econ
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga