Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Unsupervised Model Drift Estimation with Batch Normalization Statistics
  for Dataset Shift Detection and Model Selection   While many real-world data streams imply that they change frequently in a
nonstationary way, most of deep learning methods optimize neural networks on
training data, and this leads to severe performance degradation when dataset
shift happens. However, it is less possible to annotate or inspect newly
streamed data by humans, and thus it is desired to measure model drift at
inference time in an unsupervised manner. In this paper, we propose a novel
method of model drift estimation by exploiting statistics of batch
normalization layer on unlabeled test data. To remedy possible sampling error
of streamed input data, we adopt low-rank approximation to each
representational layer. We show the effectiveness of our method not only on
dataset shift detection but also on model selection when there are multiple
candidate models among model zoo or training trajectories in an unsupervised
way. We further demonstrate the consistency of our method by comparing model
drift scores between different network architectures.

26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol