Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learn to Talk via Proactive Knowledge Transfer   Knowledge Transfer has been applied in solving a wide variety of problems.
For example, knowledge can be transferred between tasks (e.g., learning to
handle novel situations by leveraging prior knowledge) or between agents (e.g.,
learning from others without direct experience). Without loss of generality, we
relate knowledge transfer to KL-divergence minimization, i.e., matching the
(belief) distributions of learners and teachers. The equivalence gives us a new
perspective in understanding variants of the KL-divergence by looking at how
learners structure their interaction with teachers in order to acquire
knowledge. In this paper, we provide an in-depth analysis of KL-divergence
minimization in Forward and Backward orders, which shows that learners are
reinforced via on-policy learning in Backward. In contrast, learners are
supervised in Forward. Moreover, our analysis is gradient-based, so it can be
generalized to arbitrary tasks and help to decide which order to minimize given
the property of the task. By replacing Forward with Backward in Knowledge
Distillation, we observed +0.7-1.1 BLEU gains on the WMT'17 De-En and IWSLT'15
Th-En machine translation tasks.

35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
4
The categories of this paper are: cond-mat
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph