Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Framework for an Assessment of the Kernel-target Alignment in Tree
  Ensemble Kernel Learning   Kernels ensuing from tree ensembles such as random forest (RF) or gradient
boosted trees (GBT), when used for kernel learning, have been shown to be
competitive to their respective tree ensembles (particularly in higher
dimensional scenarios). On the other hand, it has been also shown that
performance of the kernel algorithms depends on the degree of the kernel-target
alignment. However, the kernel-target alignment for kernel learning based on
the tree ensembles has not been investigated and filling this gap is the main
goal of our work.
  Using the eigenanalysis of the kernel matrix, we demonstrate that for
continuous targets good performance of the tree-based kernel learning is
associated with strong kernel-target alignment. Moreover, we show that well
performing tree ensemble based kernels are characterized by strong target
aligned components that are expressed through scalar products between the
eigenvectors of the kernel matrix and the target. This suggests that when tree
ensemble based kernel learning is successful, relevant information for the
supervised problem is concentrated near lower dimensional manifold spanned by
the target aligned components. Persistence of the strong target aligned
components in tree ensemble based kernels is further supported by sensitivity
analysis via landmark learning. In addition to a comprehensive simulation
study, we also provide experimental results from several real life data sets
that are in line with the simulations.

11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
3
The categories of this paper are: physics
26
The categories of this paper are: bayes-an