Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Using Control Variates with Stochastic Approximation for Variational
  Bayes and its Connection to Stochastic Linear Regression   Recently, we and several other authors have written about the possibilities
of using stochastic approximation techniques for fitting variational
approximations to intractable Bayesian posterior distributions. Naive
implementations of stochastic approximation suffer from high variance in this
setting. Several authors have therefore suggested using control variates to
reduce this variance, while we have taken a different but analogous approach to
reducing the variance which we call stochastic linear regression. In this note
we take the former perspective and derive the ideal set of control variates for
stochastic approximation variational Bayes under a certain set of assumptions.
We then show that using these control variates is closely related to using the
stochastic linear regression approximation technique we proposed earlier. A
simple example shows that our method for constructing control variates leads to
stochastic estimators with much lower variance compared to other approaches.

5
The categories of this paper are: gr-qc
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an