Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Soft Gradient Boosting Machine   Gradient Boosting Machine has proven to be one successful function
approximator and has been widely used in a variety of areas. However, since the
training procedure of each base learner has to take the sequential order, it is
infeasible to parallelize the training process among base learners for
speed-up. In addition, under online or incremental learning settings, GBMs
achieved sub-optimal performance due to the fact that the previously trained
base learners can not adapt with the environment once trained. In this work, we
propose the soft Gradient Boosting Machine (sGBM) by wiring multiple
differentiable base learners together, by injecting both local and global
objectives inspired from gradient boosting, all base learners can then be
jointly optimized with linear speed-up. When using differentiable soft decision
trees as base learner, such device can be regarded as an alternative version of
the (hard) gradient boosting decision trees with extra benefits. Experimental
results showed that, sGBM enjoys much higher time efficiency with better
accuracy, given the same base learner in both on-line and off-line settings.

3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn