Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Depth Infused Binaural Audio Generation using Hierarchical Cross-Modal
  Attention   Binaural audio gives the listener the feeling of being in the recording place
and enhances the immersive experience if coupled with AR/VR. But the problem
with binaural audio recording is that it requires a specialized setup which is
not possible to fabricate within handheld devices as compared to traditional
mono audio that can be recorded with a single microphone. In order to overcome
this drawback, prior works have tried to uplift the mono recorded audio to
binaural audio as a post processing step conditioning on the visual input. But
all the prior approaches missed other most important information required for
the task, i.e. distance of different sound producing objects from the recording
setup. In this work, we argue that the depth map of the scene can act as a
proxy for encoding distance information of objects in the scene and show that
adding depth features along with image features improves the performance both
qualitatively and quantitatively. We propose a novel encoder-decoder
architecture, where we use a hierarchical attention mechanism to encode the
image and depth feature extracted from individual transformer backbone, with
audio features at each layer of the decoder.

33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
32
The categories of this paper are: atom-ph
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg