Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Audio-Visual Target Speaker Enhancement on Multi-Talker Environment
  using Event-Driven Cameras   We propose a method to address audio-visual target speaker enhancement in
multi-talker environments using event-driven cameras. State of the art
audio-visual speech separation methods shows that crucial information is the
movement of the facial landmarks related to speech production. However, all
approaches proposed so far work offline, using frame-based video input, making
it difficult to process an audio-visual signal with low latency, for online
applications. In order to overcome this limitation, we propose the use of
event-driven cameras and exploit compression, high temporal resolution and low
latency, for low cost and low latency motion feature extraction, going towards
online embedded audio-visual speech processing. We use the event-driven optical
flow estimation of the facial landmarks as input to a stacked Bidirectional
LSTM trained to predict an Ideal Amplitude Mask that is then used to filter the
noisy audio, to obtain the audio signal of the target speaker. The presented
approach performs almost on par with the frame-based approach, with very low
latency and computational cost.

11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
2
The categories of this paper are: math