Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MoCA: Incorporating Multi-stage Domain Pretraining and Cross-guided
  Multimodal Attention for Textbook Question Answering   Textbook Question Answering (TQA) is a complex multimodal task to infer
answers given large context descriptions and abundant diagrams. Compared with
Visual Question Answering (VQA), TQA contains a large number of uncommon
terminologies and various diagram inputs. It brings new challenges to the
representation capability of language model for domain-specific spans. And it
also pushes the multimodal fusion to a more complex level. To tackle the above
issues, we propose a novel model named MoCA, which incorporates multi-stage
domain pretraining and multimodal cross attention for the TQA task. Firstly, we
introduce a multi-stage domain pretraining module to conduct unsupervised
post-pretraining with the span mask strategy and supervised pre-finetune.
Especially for domain post-pretraining, we propose a heuristic generation
algorithm to employ the terminology corpus. Secondly, to fully consider the
rich inputs of context and diagrams, we propose cross-guided multimodal
attention to update the features of text, question diagram and instructional
diagram based on a progressive strategy. Further, a dual gating mechanism is
adopted to improve the model ensemble. The experimental results show the
superiority of our model, which outperforms the state-of-the-art methods by
2.21% and 2.43% for validation and test split respectively.

15
The categories of this paper are: nucl-ex
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom