Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Memory Augmented Policy Optimization for Program Synthesis and Semantic
  Parsing   We present Memory Augmented Policy Optimization (MAPO), a simple and novel
way to leverage a memory buffer of promising trajectories to reduce the
variance of policy gradient estimate. MAPO is applicable to deterministic
environments with discrete actions, such as structured prediction and
combinatorial optimization tasks. We express the expected return objective as a
weighted sum of two terms: an expectation over the high-reward trajectories
inside the memory buffer, and a separate expectation over trajectories outside
the buffer. To make an efficient algorithm of MAPO, we propose: (1) memory
weight clipping to accelerate and stabilize training; (2) systematic
exploration to discover high-reward trajectories; (3) distributed sampling from
inside and outside of the memory buffer to scale up training. MAPO improves the
sample efficiency and robustness of policy gradient, especially on tasks with
sparse rewards. We evaluate MAPO on weakly supervised program synthesis from
natural language (semantic parsing). On the WikiTableQuestions benchmark, we
improve the state-of-the-art by 2.6%, achieving an accuracy of 46.3%. On the
WikiSQL benchmark, MAPO achieves an accuracy of 74.9% with only weak
supervision, outperforming several strong baselines with full supervision. Our
source code is available at
https://github.com/crazydonkey200/neural-symbolic-machines

26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess