Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Brain2Word: Decoding Brain Activity for Language Generation   Brain decoding, understood as the process of mapping brain activities to the
stimuli that generated them, has been an active research area in the last
years. In the case of language stimuli, recent studies have shown that it is
possible to decode fMRI scans into an embedding of the word a subject is
reading. However, such word embeddings are designed for natural language
processing tasks rather than for brain decoding. Therefore, they limit our
ability to recover the precise stimulus. In this work, we propose to directly
classify an fMRI scan, mapping it to the corresponding word within a fixed
vocabulary. Unlike existing work, we evaluate on scans from previously unseen
subjects. We argue that this is a more realistic setup and we present a model
that can decode fMRI data from unseen subjects. Our model achieves 5.22% Top-1
and 13.59% Top-5 accuracy in this challenging task, significantly outperforming
all the considered competitive baselines. Furthermore, we use the decoded words
to guide language generation with the GPT-2 model. This way, we advance the
quest for a system that translates brain activities into coherent text.

18
The categories of this paper are: econ
2
The categories of this paper are: math
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph