Prediction of brain age using structural magnetic resonance imaging: A comparison of clinical validity of publicly available software packages
Abstract
Predicting brain age from structural magnetic resonance images is commonly used as a biomarker of biological aging and brain health. Ideally, as a clinically valid biomarker, brain age should indicate the current state of health and also be predictive of future disease onset and detrimental changes in brain biology. In this preregistered study, we evaluated and compared the clinical validity, i.e., diagnostic and prognostic abilities, of six publicly available brain age prediction packages using data from the Alzheimertextquoterights Disease Neuroimaging Initiative (ADNI). Baseline brain age significantly differed between groups consisting of individuals with normal cognitive function, mild cognitive impairment, and Alzheimertextquoterights Disease for all packages, but with comparable performance to gray matter volume. Further, estimates were not centered around zero for cognitively normal subjects and showed considerable variation between packages. Finally, brain age did not show strong correlation with disease onset, memory decline, nor gray matter atrophy within four years from baseline in individuals without neurodegenerative disease. The substantial bias and variability in cross-sectional predictions, combined with the weak associations between brain age and longitudinal changes in memory performance or grey matter volume, suggested limited validity of current brain age estimates as a biomarker for biological aging.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work was supported by a Longevity Impetus Grant from the Norm Group. PPS was supported by a grant from the Swedish Brain Foundation (PD2024-0444). Data collection and sharing for the Alzheimertextquoterights Disease Neuroimaging Initiative (ADNI) is funded by the National Institute on Aging (National Institutes of Health Grant U19AG024904). The grantee organization is the Northern California Institute for Research and Education. In the past, ADNI has also received funding from the National Institute of Biomedical Imaging and Bioengineering, the Canadian Institutes of Health Research, and private sector contributions through the Foundation for the National Institutes of Health (FNIH) including generous contributions from the following: AbbVie, Alzheimertextquoterights Association; Alzheimertextquoterights Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Data used in preparation for this article were obtained from the Alzheimertextquoterights Disease Neuroimaging Initiative (ADNI) database (http://adni.loni.usc.edu).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors
Ruben P. Dörfel
Data-analysis, PhD-student
Jonas E. Svensson
Study physician, Post-doc
