Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mathematical Reasoning via Self-supervised Skip-tree Training   We examine whether self-supervised language modeling applied to mathematical
formulas enables logical reasoning. We suggest several logical reasoning tasks
that can be used to evaluate language models trained on formal mathematical
statements, such as type inference, suggesting missing assumptions and
completing equalities. To train language models for formal mathematics, we
propose a novel skip-tree task. We find that models trained on the skip-tree
task show surprisingly strong mathematical reasoning abilities, and outperform
models trained on standard skip-sequence tasks. We also analyze the models'
ability to formulate new conjectures by measuring how often the predictions are
provable and useful in other proofs.

36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
13
The categories of this paper are: quant-ph
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat