Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Transcribing Content from Structural Images with Spotlight Mechanism   Transcribing content from structural images, e.g., writing notes from music
scores, is a challenging task as not only the content objects should be
recognized, but the internal structure should also be preserved. Existing image
recognition methods mainly work on images with simple content (e.g., text lines
with characters), but are not capable to identify ones with more complex
content (e.g., structured symbols), which often follow a fine-grained grammar.
To this end, in this paper, we propose a hierarchical Spotlight Transcribing
Network (STN) framework followed by a two-stage "where-to-what" solution.
Specifically, we first decide "where-to-look" through a novel spotlight
mechanism to focus on different areas of the original image following its
structure. Then, we decide "what-to-write" by developing a GRU based network
with the spotlight areas for transcribing the content accordingly. Moreover, we
propose two implementations on the basis of STN, i.e., STNM and STNR, where the
spotlight movement follows the Markov property and Recurrent modeling,
respectively. We also design a reinforcement method to refine the framework by
self-improving the spotlight mechanism. We conduct extensive experiments on
many structural image datasets, where the results clearly demonstrate the
effectiveness of STN framework.

7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph