Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Transformer-based Math Language Model for Handwritten Math Expression
  Recognition   Handwritten mathematical expressions (HMEs) contain ambiguities in their
interpretations, even for humans sometimes. Several math symbols are very
similar in the writing style, such as dot and comma or 0, O, and o, which is a
challenge for HME recognition systems to handle without using contextual
information. To address this problem, this paper presents a Transformer-based
Math Language Model (TMLM). Based on the self-attention mechanism, the
high-level representation of an input token in a sequence of tokens is computed
by how it is related to the previous tokens. Thus, TMLM can capture long
dependencies and correlations among symbols and relations in a mathematical
expression (ME). We trained the proposed language model using a corpus of
approximately 70,000 LaTeX sequences provided in CROHME 2016. TMLM achieved the
perplexity of 4.42, which outperformed the previous math language models, i.e.,
the N-gram and recurrent neural network-based language models. In addition, we
combine TMLM into a stochastic context-free grammar-based HME recognition
system using a weighting parameter to re-rank the top-10 best candidates. The
expression rates on the testing sets of CROHME 2016 and CROHME 2019 were
improved by 2.97 and 0.83 percentage points, respectively.

34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
31
The categories of this paper are: ao-sci
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg