Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Debiased Models with Dynamic Gradient Alignment and
  Bias-conflicting Sample Mining   Deep neural networks notoriously suffer from dataset biases which are
detrimental to model robustness, generalization and fairness. In this work, we
propose a two-stage debiasing scheme to combat against the intractable unknown
biases. Starting by analyzing the factors of the presence of biased models, we
design a novel learning objective which cannot be reached by relying on biases
alone. Specifically, debiased models are achieved with the proposed Gradient
Alignment (GA) which dynamically balances the contributions of bias-aligned and
bias-conflicting samples (refer to samples with/without bias cues respectively)
throughout the whole training process, enforcing models to exploit intrinsic
cues to make fair decisions. While in real-world scenarios, the potential
biases are extremely hard to discover and prohibitively expensive to label
manually. We further propose an automatic bias-conflicting sample mining method
by peer-picking and training ensemble without prior knowledge of bias
information. Experiments conducted on multiple datasets in various settings
demonstrate the effectiveness and robustness of our proposed scheme, which
successfully alleviates the negative impact of unknown biases and achieves
state-of-the-art performance.

12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
2
The categories of this paper are: math
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
27
The categories of this paper are: comp-gas
30
The categories of this paper are: q-alg
20
The categories of this paper are: acc-phys
15
The categories of this paper are: nucl-ex
16
The categories of this paper are: stat
13
The categories of this paper are: quant-ph
23
The categories of this paper are: solv-int
36
The categories of this paper are: cmp-lg
10
The categories of this paper are: q-bio