Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Audio-to-symbolic Arrangement via Cross-modal Music Representation
  Learning   Could we automatically derive the score of a piano accompaniment based on the
audio of a pop song? This is the audio-to-symbolic arrangement problem we
tackle in this paper. A good arrangement model should not only consider the
audio content but also have prior knowledge of piano composition (so that the
generation "sounds like" the audio and meanwhile maintains musicality). To this
end, we contribute a cross-modal representation-learning model, which 1)
extracts chord and melodic information from the audio, and 2) learns texture
representation from both audio and a corrupted ground truth arrangement. We
further introduce a tailored training strategy that gradually shifts the source
of texture information from corrupted score to audio. In the end, the
score-based texture posterior is reduced to a standard normal distribution, and
only audio is needed for inference. Experiments show that our model captures
major audio information and outperforms baselines in generation quality.

4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
11
The categories of this paper are: hep-lat
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con