Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: From Consensus to Disagreement: Multi-Teacher Distillation for
  Semi-Supervised Relation Extraction   Lack of labeled data is a main obstacle in relation extraction.
Semi-supervised relation extraction (SSRE) has been proven to be a promising
way for this problem through annotating unlabeled samples as additional
training data. Almost all prior researches along this line adopt multiple
models to make the annotations more reliable by taking the intersection set of
predicted results from these models. However, the difference set, which
contains rich information about unlabeled data, has been long neglected by
prior studies.
  In this paper, we propose to learn not only from the consensus but also the
disagreement among different models in SSRE. To this end, we develop a simple
and general multi-teacher distillation (MTD) framework, which can be easily
integrated into any existing SSRE methods. Specifically, we first let the
teachers correspond to the multiple models and select the samples in the
intersection set of the last iteration in SSRE methods to augment labeled data
as usual. We then transfer the class distributions for samples in the
difference set as soft labels to guide the student. We finally perform
prediction using the trained student model. Experimental results on two public
datasets demonstrate that our framework significantly promotes the performance
of the base SSRE methods with pretty low computational cost.

0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
14
The categories of this paper are: math-ph
16
The categories of this paper are: stat
2
The categories of this paper are: math
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat