Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Meta-learning with an Adaptive Task Scheduler   To benefit the learning of a new task, meta-learning has been proposed to
transfer a well-generalized meta-model learned from various meta-training
tasks. Existing meta-learning algorithms randomly sample meta-training tasks
with a uniform probability, under the assumption that tasks are of equal
importance. However, it is likely that tasks are detrimental with noise or
imbalanced given a limited number of meta-training tasks. To prevent the
meta-model from being corrupted by such detrimental tasks or dominated by tasks
in the majority, in this paper, we propose an adaptive task scheduler (ATS) for
the meta-training process. In ATS, for the first time, we design a neural
scheduler to decide which meta-training tasks to use next by predicting the
probability being sampled for each candidate task, and train the scheduler to
optimize the generalization capacity of the meta-model to unseen tasks. We
identify two meta-model-related factors as the input of the neural scheduler,
which characterize the difficulty of a candidate task to the meta-model.
Theoretically, we show that a scheduler taking the two factors into account
improves the meta-training loss and also the optimization landscape. Under the
setting of meta-learning with noise and limited budgets, ATS improves the
performance on both miniImageNet and a real-world drug discovery benchmark by
up to 13% and 18%, respectively, compared to state-of-the-art task schedulers.

0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
2
The categories of this paper are: math