Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Explaining random forest prediction through diverse rulesets   Tree-ensemble algorithms, such as random forest, are effective machine
learning methods popular for their flexibility, high performance, and
robustness to overfitting. However, since multiple learners are combined,they
are not as interpretable as a single decision tree. In this work we propose a
methodology, called Local Tree eXtractor (LTreeX) which is able to explain the
forest prediction for a given test instance with a few diverse rules. Starting
from the decision trees generated by a random forest, our method 1) pre-selects
a subset of them, 2) creates a vector representation, and 3) eventually
clusters such a representation. Each cluster prototype results in a rule that
explains the test instance prediction. We test the effectiveness of LTreeX on
71 real-world datasets and we demonstrate the validity of our approach for
binary classification, regression, multi-label classification and time-to-event
tasks. In all set-ups, we show that our extracted surrogate model manages to
approximate the performance of the corresponding ensemble model, while
selecting only few trees from the whole forest.We also show that our proposed
approach substantially outperforms other explainable methods in terms of
predictive performance.

23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
16
The categories of this paper are: stat
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
19
The categories of this paper are: eess
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom