Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Last-Layer Algorithms for Classification: Decoupling Representation
  from Uncertainty Estimation   Uncertainty quantification for deep learning is a challenging open problem.
Bayesian statistics offer a mathematically grounded framework to reason about
uncertainties; however, approximate posteriors for modern neural networks still
require prohibitive computational costs. We propose a family of algorithms
which split the classification task into two stages: representation learning
and uncertainty estimation. We compare four specific instances, where
uncertainty estimation is performed via either an ensemble of Stochastic
Gradient Descent or Stochastic Gradient Langevin Dynamics snapshots, an
ensemble of bootstrapped logistic regressions, or via a number of Monte Carlo
Dropout passes. We evaluate their performance in terms of \emph{selective}
classification (risk-coverage), and their ability to detect out-of-distribution
samples. Our experiments suggest there is limited value in adding multiple
uncertainty layers to deep classifiers, and we observe that these simple
methods strongly outperform a vanilla point-estimate SGD in some complex
benchmarks like ImageNet.

5
The categories of this paper are: gr-qc
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph