  Deep learning has yet to revolutionize general practices in healthcare,
despite promising results for some specific tasks. This is partly due to data
being in insufficient quantities hurting the training of the models. To address
this issue, data from multiple health actors or patients could be combined by
capitalizing on their heterogeneity through the use of transfer learning.
  To improve the quality of the transfer between multiple sources of data, we
propose a multi-source adversarial transfer learning framework that enables the
learning of a feature representation that is similar across the sources, and
thus more general and more easily transferable. We apply this idea to glucose
forecasting for diabetic people using a fully convolutional neural network. The
evaluation is done by exploring various transfer scenarios with three datasets
characterized by their high inter and intra variability.
  While transferring knowledge is beneficial in general, we show that the
statistical and clinical accuracies can be further improved by using of the
adversarial training methodology, surpassing the current state-of-the-art
results. In particular, it shines when using data from different datasets, or
when there is too little data in an intra-dataset situation. To understand the
behavior of the models, we analyze the learnt feature representations and
propose a new metric in this regard. Contrary to a standard transfer, the
adversarial transfer does not discriminate the patients and datasets, helping
the learning of a more general feature representation.
  The adversarial training framework improves the learning of a general feature
representation in a multi-source environment, enhancing the knowledge transfer
to an unseen target.
  The proposed method can help improve the efficiency of data shared by
different health actors in the training of deep models.
