Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multiple Policy Value Monte Carlo Tree Search   Many of the strongest game playing programs use a combination of Monte Carlo
tree search (MCTS) and deep neural networks (DNN), where the DNNs are used as
policy or value evaluators. Given a limited budget, such as online playing or
during the self-play phase of AlphaZero (AZ) training, a balance needs to be
reached between accurate state estimation and more MCTS simulations, both of
which are critical for a strong game playing agent. Typically, larger DNNs are
better at generalization and accurate evaluation, while smaller DNNs are less
costly, and therefore can lead to more MCTS simulations and bigger search trees
with the same budget. This paper introduces a new method called the multiple
policy value MCTS (MPV-MCTS), which combines multiple policy value neural
networks (PV-NNs) of various sizes to retain advantages of each network, where
two PV-NNs f_S and f_L are used in this paper. We show through experiments on
the game NoGo that a combined f_S and f_L MPV-MCTS outperforms single PV-NN
with policy value MCTS, called PV-MCTS. Additionally, MPV-MCTS also outperforms
PV-MCTS for AZ training.

14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org