  Mood inference with mobile sensing data has been studied in ubicomp
literature over the last decade. This inference enables context-aware and
personalized user experiences in general mobile apps and valuable feedback and
interventions in mobile health apps. However, even though model generalization
issues have been highlighted in many studies, the focus has always been on
improving the accuracies of models using different sensing modalities and
machine learning techniques, with datasets collected in homogeneous
populations. In contrast, less attention has been given to studying the
performance of mood inference models to assess whether models generalize to new
countries. In this study, we collected a mobile sensing dataset with 329K
self-reports from 678 participants in eight countries (China, Denmark, India,
Italy, Mexico, Mongolia, Paraguay, UK) to assess the effect of geographical
diversity on mood inference models. We define and evaluate country-specific
(trained and tested within a country), continent-specific (trained and tested
within a continent), country-agnostic (tested on a country not seen on training
data), and multi-country (trained and tested with multiple countries)
approaches trained on sensor data for two mood inference tasks with
population-level (non-personalized) and hybrid (partially personalized) models.
We show that partially personalized country-specific models perform the best
yielding area under the receiver operating characteristic curve (AUROC) scores
of the range 0.78-0.98 for two-class (negative vs. positive valence) and
0.76-0.94 for three-class (negative vs. neutral vs. positive valence)
inference. Overall, we uncover generalization issues of mood inference models
to new countries and how the geographical similarity of countries might impact
mood inference.
