  Human affect and mental state estimation in an automated manner, face a
number of difficulties, including learning from labels with poor or no temporal
resolution, learning from few datasets with little data (often due to
confidentiality constraints) and, (very) long, in-the-wild videos. For these
reasons, deep learning methodologies tend to overfit, that is, arrive at latent
representations with poor generalisation performance on the final regression
task. To overcome this, in this work, we introduce two complementary
contributions. First, we introduce a novel relational loss for multilabel
regression and ordinal problems that regularises learning and leads to better
generalisation. The proposed loss uses label vector inter-relational
information to learn better latent representations by aligning batch label
distances to the distances in the latent feature space. Second, we utilise a
two-stage attention architecture that estimates a target for each clip by using
features from the neighbouring clips as temporal context. We evaluate the
proposed methodology on both continuous affect and schizophrenia severity
estimation problems, as there are methodological and contextual parallels
between the two. Experimental results demonstrate that the proposed methodology
outperforms all baselines. In the domain of schizophrenia, the proposed
methodology outperforms previous state-of-the-art by a large margin, achieving
a PCC of up to 78% performance close to that of human experts (85%) and much
higher than previous works (uplift of up to 40%). In the case of affect
recognition, we outperform previous vision-based methods in terms of CCC on
both the OMG and the AMIGOS datasets. Specifically for AMIGOS, we outperform
previous SoTA CCC for both arousal and valence by 9% and 13% respectively, and
in the OMG dataset we outperform previous vision works by up to 5% for both
arousal and valence.
