  To train machine learning algorithms to predict emotional expressions in
terms of arousal and valence, annotated datasets are needed. However, as
different people perceive others' emotional expressions differently, their
annotations are subjective. To account for this, annotations are typically
collected from multiple annotators and averaged to obtain ground-truth labels.
However, when exclusively trained on this averaged ground-truth, the model is
agnostic to the inherent subjectivity in emotional expressions. In this work,
we therefore propose an end-to-end Bayesian neural network capable of being
trained on a distribution of annotations to also capture the subjectivity-based
label uncertainty. Instead of a Gaussian, we model the annotation distribution
using Student's t-distribution, which also accounts for the number of
annotations available. We derive the corresponding Kullback-Leibler divergence
loss and use it to train an estimator for the annotation distribution, from
which the mean and uncertainty can be inferred. We validate the proposed method
using two in-the-wild datasets. We show that the proposed t-distribution based
approach achieves state-of-the-art uncertainty modeling results in speech
emotion recognition, and also consistent results in cross-corpora evaluations.
Furthermore, analyses reveal that the advantage of a t-distribution over a
Gaussian grows with increasing inter-annotator correlation and a decreasing
number of annotations available.
