Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Robustifying Sequential Neural Processes   When tasks change over time, meta-transfer learning seeks to improve the
efficiency of learning a new task via both meta-learning and transfer-learning.
While the standard attention has been effective in a variety of settings, we
question its effectiveness in improving meta-transfer learning since the tasks
being learned are dynamic and the amount of context can be substantially
smaller. In this paper, using a recently proposed meta-transfer learning model,
Sequential Neural Processes (SNP), we first empirically show that it suffers
from a similar underfitting problem observed in the functions inferred by
Neural Processes. However, we further demonstrate that unlike the meta-learning
setting, the standard attention mechanisms are not effective in meta-transfer
setting. To resolve, we propose a new attention mechanism, Recurrent Memory
Reconstruction (RMR), and demonstrate that providing an imaginary context that
is recurrently updated and reconstructed with interaction is crucial in
achieving effective attention for meta-transfer learning. Furthermore,
incorporating RMR into SNP, we propose Attentive Sequential Neural
Processes-RMR (ASNP-RMR) and demonstrate in various tasks that ASNP-RMR
significantly outperforms the baselines.

30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
18
The categories of this paper are: econ
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
28
The categories of this paper are: alg-geom