Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Explaining Machine Learning Models by Evolving Crucial and Compact
  Features   Feature construction can substantially improve the accuracy of Machine
Learning (ML) algorithms. Genetic Programming (GP) has been proven to be
effective at this task by evolving non-linear combinations of input features.
GP additionally has the potential to improve ML explainability since explicit
expressions are evolved. Yet, in most GP works the complexity of evolved
features is not explicitly bound or minimized though this is arguably key for
explainability. In this article, we assess to what extent GP still performs
favorably at feature construction when constructing features that are (1) Of
small-enough number, to enable visualization of the behavior of the ML model;
(2) Of small-enough size, to enable interpretability of the features
themselves; (3) Of sufficient informative power, to retain or even improve the
performance of the ML algorithm. We consider a simple feature construction
scheme using three different GP algorithms, as well as random search, to evolve
features for five ML algorithms, including support vector machines and random
forest. Our results on 21 datasets pertaining to classification and regression
problems show that constructing only two compact features can be sufficient to
rival the use of the entire original feature set. We further find that a modern
GP algorithm, GP-GOMEA, performs best overall. These results, combined with
examples that we provide of readable constructed features and of 2D
visualizations of ML behavior, lead us to positively conclude that GP-based
feature construction still works well when explicitly searching for compact
features, making it extremely helpful to explain ML models.

35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
25
The categories of this paper are: patt-sol
13
The categories of this paper are: quant-ph