  We present the findings of "The Alzheimer's Disease Prediction Of
Longitudinal Evolution" (TADPOLE) Challenge, which compared the performance of
92 algorithms from 33 international teams at predicting the future trajectory
of 219 individuals at risk of Alzheimer's disease. Challenge participants were
required to make a prediction, for each month of a 5-year future time period,
of three key outcomes: clinical diagnosis, Alzheimer's Disease Assessment Scale
Cognitive Subdomain (ADAS-Cog13), and total volume of the ventricles. The
methods used by challenge participants included multivariate linear regression,
machine learning methods such as support vector machines and deep neural
networks, as well as disease progression models. No single submission was best
at predicting all three outcomes. For clinical diagnosis and ventricle volume
prediction, the best algorithms strongly outperform simple baselines in
predictive ability. However, for ADAS-Cog13 no single submitted prediction
method was significantly better than random guesswork. Two ensemble methods
based on taking the mean and median over all predictions, obtained top scores
on almost all tasks. Better than average performance at diagnosis prediction
was generally associated with the additional inclusion of features from
cerebrospinal fluid (CSF) samples and diffusion tensor imaging (DTI). On the
other hand, better performance at ventricle volume prediction was associated
with inclusion of summary statistics, such as the slope or maxima/minima of
biomarkers. TADPOLE's unique results suggest that current prediction algorithms
provide sufficient accuracy to exploit biomarkers related to clinical diagnosis
and ventricle volume, for cohort refinement in clinical trials for Alzheimer's
disease. However, results call into question the usage of cognitive test scores
for patient selection and as a primary endpoint in clinical trials.
