Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Active Testing: An Unbiased Evaluation Method for Distantly Supervised
  Relation Extraction   Distant supervision has been a widely used method for neural relation
extraction for its convenience of automatically labeling datasets. However,
existing works on distantly supervised relation extraction suffer from the low
quality of test set, which leads to considerable biased performance evaluation.
These biases not only result in unfair evaluations but also mislead the
optimization of neural relation extraction. To mitigate this problem, we
propose a novel evaluation method named active testing through utilizing both
the noisy test set and a few manual annotations. Experiments on a widely used
benchmark show that our proposed approach can yield approximately unbiased
evaluations for distantly supervised relation extractors.

36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
33
The categories of this paper are: plasm-ph
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn