Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Transformer-Based Source-Free Domain Adaptation   In this paper, we study the task of source-free domain adaptation (SFDA),
where the source data are not available during target adaptation. Previous
works on SFDA mainly focus on aligning the cross-domain distributions. However,
they ignore the generalization ability of the pretrained source model, which
largely influences the initial target outputs that are vital to the target
adaptation stage. To address this, we make the interesting observation that the
model accuracy is highly correlated with whether or not attention is focused on
the objects in an image. To this end, we propose a generic and effective
framework based on Transformer, named TransDA, for learning a generalized model
for SFDA. Specifically, we apply the Transformer as the attention module and
inject it into a convolutional network. By doing so, the model is encouraged to
turn attention towards the object regions, which can effectively improve the
model's generalization ability on the target domains. Moreover, a novel
self-supervised knowledge distillation approach is proposed to adapt the
Transformer with target pseudo-labels, thus further encouraging the network to
focus on the object regions. Experiments on three domain adaptation tasks,
including closed-set, partial-set, and open-set adaption, demonstrate that
TransDA can greatly improve the adaptation accuracy and produce
state-of-the-art results. The source code and trained models are available at
https://github.com/ygjwd12345/TransDA.

35
The categories of this paper are: mtrl-th
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con