Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Non-convex Learning via Replica Exchange Stochastic Gradient MCMC   Replica exchange Monte Carlo (reMC), also known as parallel tempering, is an
important technique for accelerating the convergence of the conventional Markov
Chain Monte Carlo (MCMC) algorithms. However, such a method requires the
evaluation of the energy function based on the full dataset and is not scalable
to big data. The na\"ive implementation of reMC in mini-batch settings
introduces large biases, which cannot be directly extended to the stochastic
gradient MCMC (SGMCMC), the standard sampling method for simulating from deep
neural networks (DNNs). In this paper, we propose an adaptive replica exchange
SGMCMC (reSGMCMC) to automatically correct the bias and study the corresponding
properties. The analysis implies an acceleration-accuracy trade-off in the
numerical discretization of a Markov jump process in a stochastic environment.
Empirically, we test the algorithm through extensive experiments on various
setups and obtain the state-of-the-art results on CIFAR10, CIFAR100, and SVHN
in both supervised learning and semi-supervised learning tasks.

18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
5
The categories of this paper are: gr-qc
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
34
The categories of this paper are: chem-ph
12
The categories of this paper are: nucl-th
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol