Predicting Four-Year’s Alzheimer’s Disease Onset Using Longitudinal Neurocognitive Tests and MRI Data Using Explainable Deep Convolutional Neural Networks

Article type: Research Article

Authors: Bapat, Rohan^a | Ma, Da^b | Duong, Tim Q.^{a; *}

Affiliations: [a] Department of Radiology, Albert Einstein College of Medicine and Montefiore Medical Center, Bronx, NY, USA | [b] Department of Internal Medicine Section of Gerontology and Geriatric Medicine, Wake Forest University School of Medicine, Winston-Salam, NC, USA

Correspondence: [*] Correspondence to: Tim Duong, PhD, Department of Radiology, Albert Einstein College of Medicine and Montefiore Health System, 111 E 210th St, Bronx, NY 10467, USA. E-mail: [email protected].

Abstract: Background: Prognosis of future risk of dementia from neuroimaging and cognitive data is important for optimizing clinical management for patients at early stage of Alzheimer’s disease (AD). However, existing studies lack an efficient way to integrate longitudinal information from both modalities to improve prognosis performance. Objective: In this study, we aim to develop and evaluate an explainable deep learning-based framework to predict mild cognitive impairment (MCI) to AD conversion within four years using longitudinal whole-brain 3D MRI and neurocognitive tests. Methods: We proposed a two-stage framework that first uses a 3D convolutional neural network to extract single-timepoint MRI-based AD-related latent features, followed by multi-modal longitudinal feature concatenation and a 1D convolutional neural network to predict the risk of future dementia onset in four years. Results: The proposed deep learning framework showed promising to predict MCI to AD conversion within 4 years using longitudinal whole-brain 3D MRI and cognitive data without extracting regional brain volumes or cortical thickness, reaching a balanced accuracy of 0.834, significantly improved from models trained from single timepoint or single modality. The post hoc model explainability revealed heatmap indicating regions that are important for predicting future risk of AD. Conclusions: The proposed framework sets the stage for future studies for using multi-modal longitudinal data to achieve optimal prediction for prognosis of AD onset, leading to better management of the diseases, thereby improving the quality of life.

Keywords: Alzheimer’s disease, amyloid, artificial intelligence, deep learning, dementia, magnetic resonance imaging, mild cognitive impairment, tau

DOI: 10.3233/JAD-230893

Journal: Journal of Alzheimer's Disease, vol. 97, no. 1, pp. 459-469, 2024