loading page

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints
  • +6
  • Yilin Leng ,
  • Wenjun Cui ,
  • Yunsong Peng ,
  • Caiying Yan ,
  • Yuzhu Cao ,
  • Zhuangzhi Yan ,
  • Shuangqing Chen ,
  • Xi Jiang ,
  • Jian Zheng
Yilin Leng
Shanghai University, Shanghai University

Corresponding Author:[email protected]

Author Profile
Wenjun Cui
Author Profile
Yunsong Peng
Author Profile
Caiying Yan
Author Profile
Yuzhu Cao
Author Profile
Zhuangzhi Yan
Author Profile
Shuangqing Chen
Author Profile
Jian Zheng
Author Profile


Deep learning methods using multimodal imagings have been proposed for the diagnosis of Alzheimer’s disease (AD) and its early stages (SMC, subjective memory complaints), which may help to slow the progression of the disease through early intervention. However, current fusion methods for multimodal imagings are generally coarse and may lead to suboptimal results through the use of shared extractors or simple downscaling stitching. Another issue with diagnosing brain diseases is that they often affect multiple areas of the brain, making it important to consider potential connections throughout the brain. However, traditional convolutional neural networks (CNNs) may struggle with this issue due to their limited local receptive fields. To address this, many researchers have turned to transformer networks, which can provide global information about the brain but can be computationally intensive and perform poorly on small datasets. In this work, we propose a novel lightweight network called MENet that adaptively recalibrates the multiscale long-range receptive field to localize discriminative brain regions in a computationally efficient manner. Based on this, the network extracts the intensity and location responses between sMRI and FDG-PET as an enhancement fusion for AD and SMC diagnosis. Our method is evaluated on the publicly available ADNI datasets and achieves 97.67% accuracy in AD diagnosis tasks and 81.63% accuracy in SMC diagnosis tasks using sMRI and FDG-PET. These results achieve state-of-the-art (SOTA) performance in both tasks. To the best of our knowledge, this is one of the first deep learning research method for SMC diagnosis with FDG-PET.
May 2023Published in Computers in Biology and Medicine volume 157 on pages 106788. 10.1016/j.compbiomed.2023.106788