Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Compound Word Transformer: Learning to Compose Full-Song Music over
  Dynamic Directed Hypergraphs   To apply neural sequence models such as the Transformers to music generation
tasks, one has to represent a piece of music by a sequence of tokens drawn from
a finite set of pre-defined vocabulary. Such a vocabulary usually involves
tokens of various types. For example, to describe a musical note, one needs
separate tokens to indicate the note's pitch, duration, velocity (dynamics),
and placement (onset time) along the time grid. While different types of tokens
may possess different properties, existing models usually treat them equally,
in the same way as modeling words in natural languages. In this paper, we
present a conceptually different approach that explicitly takes into account
the type of the tokens, such as note types and metric types. And, we propose a
new Transformer decoder architecture that uses different feed-forward heads to
model tokens of different types. With an expansion-compression trick, we
convert a piece of music to a sequence of compound words by grouping
neighboring tokens, greatly reducing the length of the token sequences. We show
that the resulting model can be viewed as a learner over dynamic directed
hypergraphs. And, we employ it to learn to compose expressive Pop piano music
of full-song length (involving up to 10K individual tokens per song), both
conditionally and unconditionally. Our experiment shows that, compared to
state-of-the-art models, the proposed model converges 5--10 times faster at
training (i.e., within a day on a single GPU with 11 GB memory), and with
comparable quality in the generated music.

14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
4
The categories of this paper are: cond-mat
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn