Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: L_DMI: An Information-theoretic Noise-robust Loss Function   Accurately annotating large scale dataset is notoriously expensive both in
time and in money. Although acquiring low-quality-annotated dataset can be much
cheaper, it often badly damages the performance of trained models when using
such dataset without particular treatment. Various methods have been proposed
for learning with noisy labels. However, most methods only handle limited kinds
of noise patterns, require auxiliary information or steps (e.g. , knowing or
estimating the noise transition matrix), or lack theoretical justification. In
this paper, we propose a novel information-theoretic loss function,
$\mathcal{L}_{DMI}$, for training deep neural networks robust to label noise.
The core of $\mathcal{L}_{DMI}$ is a generalized version of mutual information,
termed Determinant based Mutual Information (DMI), which is not only
information-monotone but also relatively invariant. \emph{To the best of our
knowledge, $\mathcal{L}_{DMI}$ is the first loss function that is provably
robust to instance-independent label noise, regardless of noise pattern, and it
can be applied to any existing classification neural networks straightforwardly
without any auxiliary information}. In addition to theoretical justification,
we also empirically show that using $\mathcal{L}_{DMI}$ outperforms all other
counterparts in the classification task on both image dataset and natural
language dataset include Fashion-MNIST, CIFAR-10, Dogs vs. Cats, MR with a
variety of synthesized noise patterns and noise amounts, as well as a
real-world dataset Clothing1M. Codes are available at
https://github.com/Newbeeer/L_DMI .

0
The categories of this paper are: hep-ph
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
11
The categories of this paper are: hep-lat