Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Unsupervised Speech Representation Learning for Behavior Modeling using
  Triplet Enhanced Contextualized Networks   Speech encodes a wealth of information related to human behavior and has been
used in a variety of automated behavior recognition tasks. However, extracting
behavioral information from speech remains challenging including due to
inadequate training data resources stemming from the often low occurrence
frequencies of specific behavioral patterns. Moreover, supervised behavioral
modeling typically relies on domain-specific construct definitions and
corresponding manually-annotated data, rendering generalizing across domains
challenging. In this paper, we exploit the stationary properties of human
behavior within an interaction and present a representation learning method to
capture behavioral information from speech in an unsupervised way. We
hypothesize that nearby segments of speech share the same behavioral context
and hence map onto similar underlying behavioral representations. We present an
encoder-decoder based Deep Contextualized Network (DCN) as well as a
Triplet-Enhanced DCN (TE-DCN) framework to capture the behavioral context and
derive a manifold representation, where speech frames with similar behaviors
are closer while frames of different behaviors maintain larger distances. The
models are trained on movie audio data and validated on diverse domains
including on a couples therapy corpus and other publicly collected data (e.g.,
stand-up comedy). With encouraging results, our proposed framework shows the
feasibility of unsupervised learning within cross-domain behavioral modeling.

8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
2
The categories of this paper are: math
16
The categories of this paper are: stat
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg