Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Shaking the foundations: delusions in sequence models for interaction
  and control   The recent phenomenal success of language models has reinvigorated machine
learning research, and large sequence models such as transformers are being
applied to a variety of domains. One important problem class that has remained
relatively elusive however is purposeful adaptive behavior. Currently there is
a common perception that sequence models "lack the understanding of the cause
and effect of their actions" leading them to draw incorrect inferences due to
auto-suggestive delusions. In this report we explain where this mismatch
originates, and show that it can be resolved by treating actions as causal
interventions. Finally, we show that in supervised learning, one can teach a
system to condition or intervene on data by training with factual and
counterfactual error signals respectively.

37
The categories of this paper are: supr-con
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin