Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning stochastic dynamics and predicting emergent behavior using
  transformers   We show that a neural network originally designed for language processing can
learn the dynamical rules of a stochastic system by observation of a single
dynamical trajectory of the system, and can accurately predict its emergent
behavior under conditions not observed during training. We consider a lattice
model of active matter undergoing continuous-time Monte Carlo dynamics,
simulated at a density at which its steady state comprises small, dispersed
clusters. We train a neural network called a transformer on a single trajectory
of the model. The transformer, which we show has the capacity to represent
dynamical rules that are numerous and nonlocal, learns that the dynamics of
this model consists of a small number of processes. Forward-propagated
trajectories of the trained transformer, at densities not encountered during
training, exhibit motility-induced phase separation and so predict the
existence of a nonequilibrium phase transition. Transformers have the
flexibility to learn dynamical rules from observation without explicit
enumeration of rates or coarse-graining of configuration space, and so the
procedure used here can be applied to a wide range of physical systems,
including those with large and complex dynamical generators.

25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin