Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Augment and Reduce: Stochastic Inference for Large Categorical
  Distributions   Categorical distributions are ubiquitous in machine learning, e.g., in
classification, language models, and recommendation systems. However, when the
number of possible outcomes is very large, using categorical distributions
becomes computationally expensive, as the complexity scales linearly with the
number of outcomes. To address this problem, we propose augment and reduce
(A&R), a method to alleviate the computational complexity. A&R uses two ideas:
latent variable augmentation and stochastic variational inference. It maximizes
a lower bound on the marginal likelihood of the data. Unlike existing methods
which are specific to softmax, A&R is more general and is amenable to other
categorical models, such as multinomial probit. On several large-scale
classification problems, we show that A&R provides a tighter bound on the
marginal likelihood and has better predictive performance than existing
approaches.

22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
27
The categories of this paper are: comp-gas
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph