  Multiple Sclerosis (MS) is a chronic progressive neurological disease
characterized by the development of lesions in the white matter of the brain.
T2-fluid-attenuated inversion recovery (FLAIR) brain magnetic resonance imaging
(MRI) provides superior visualization and characterization of MS lesions,
relative to other MRI modalities. Longitudinal brain FLAIR MRI in MS, involving
repetitively imaging a patient over time, provides helpful information for
clinicians towards monitoring disease progression. Predicting future whole
brain MRI examinations with variable time lag has only been attempted in
limited applications, such as healthy aging and structural degeneration in
Alzheimer's Disease. In this article, we present novel modifications to deep
learning architectures for MS FLAIR image synthesis, in order to support
prediction of longitudinal images in a flexible continuous way. This is
achieved with learned transposed convolutions, which support modelling time as
a spatially distributed array with variable temporal properties at different
spatial locations. Thus, this approach can theoretically model
spatially-specific time-dependent brain development, supporting the modelling
of more rapid growth at appropriate physical locations, such as the site of an
MS brain lesion. This approach also supports the clinician user to define how
far into the future a predicted examination should target. Accurate prediction
of future rounds of imaging can inform clinicians of potentially poor patient
outcomes, which may be able to contribute to earlier treatment and better
prognoses. Four distinct deep learning architectures have been developed. The
ISBI2015 longitudinal MS dataset was used to validate and compare our proposed
approaches. Results demonstrate that a modified ACGAN achieves the best
performance and reduces variability in model accuracy.
