Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Bayesian Neural Network Priors Revisited   Isotropic Gaussian priors are the de facto standard for modern Bayesian
neural network inference. However, it is unclear whether these priors
accurately reflect our true beliefs about the weight distributions or give
optimal performance. To find better priors, we study summary statistics of
neural network weights in networks trained using stochastic gradient descent
(SGD). We find that convolutional neural network (CNN) and ResNet weights
display strong spatial correlations, while fully connected networks (FCNNs)
display heavy-tailed weight distributions. We show that building these
observations into priors can lead to improved performance on a variety of image
classification datasets. Surprisingly, these priors mitigate the cold posterior
effect in FCNNs, but slightly increase the cold posterior effect in ResNets.

21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
2
The categories of this paper are: math