Advances in Multimodal Data Fusion in Neuroimaging: Overview, Challenges, and Novel Orientation

Zhang, Yu-Dong; Dong, Zhengchao; Wang, Shui-Hua; Yu, Xiang; Yao, Xujing; Zhou, Qinghua; Hu, Hua; Li, Min; Jiménez-Mesa, Carmen; Ramirez, Javier; Martinez, Francisco J.; Gorriz, Juan Manuel

Multimodal fusion in neuroimaging combines data from multiple imaging modalities to overcome the fundamental limitations of individual modalities. Neuroimaging fusion can achieve higher temporal and spatial resolution, enhance contrast, correct imaging distortions, and bridge physiological and cognitive information. In this study, we analyzed over 450 references from PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, and various sources published from 1978 to 2020. We provide a review that encompasses (1) an overview of current challenges in multimodal fusion (2) the current medical applications of fusion for specific neurological diseases, (3) strengths and limitations of available imaging modalities, (4) fundamental fusion rules, (5) fusion quality assessment methods, and (6) the applications of fusion for atlas-based segmentation and quantification. Overall, multimodal fusion shows significant benefits in clinical diagnosis and neuroscience research. Widespread education and further research amongst engineers, researchers and clinicians will benefit the field of multimodal neuroimaging.