Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Teacher-Student Consistency For Multi-Source Domain Adaptation   In Multi-Source Domain Adaptation (MSDA), models are trained on samples from
multiple source domains and used for inference on a different, target, domain.
Mainstream domain adaptation approaches learn a joint representation of source
and target domains. Unfortunately, a joint representation may emphasize
features that are useful for the source domains but hurt inference on target
(negative transfer), or remove essential information about the target domain
(knowledge fading).
  We propose Multi-source Student Teacher (MUST), a novel procedure designed to
alleviate these issues. The key idea has two steps: First, we train a teacher
network on source labels and infer pseudo labels on the target. Then, we train
a student network using the pseudo labels and regularized the teacher to fit
the student predictions. This regularization helps the teacher predictions on
the target data remain consistent between epochs. Evaluations of MUST on three
MSDA benchmarks: digits, text sentiment analysis, and visual-object recognition
show that MUST outperforms current SoTA, sometimes by a very large margin. We
further analyze the solutions and the dynamics of the optimization showing that
the learned models follow the target distribution density, implicitly using it
as information within the unlabeled target data.

13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
2
The categories of this paper are: math
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph