Revolutionizing tumor detection and classification in multimodality imaging based on deep learning approaches: Methods, applications and limitations

Article type: Review Article

Authors: Hussain, Dildar^a | Al-masni, Mohammed A.^a | Aslam, Muhammad^a | Sadeghi-Niaraki, Abolghasem^b | Hussain, Jamil^a | Gu, Yeong Hyeon^{a; *} | Naqvi, Rizwan Ali^{c; *}

Affiliations: [a] Department of Artificial Intelligence and Data Science, Sejong University, Seoul, Korea | [b] Department of Computer Science & Engineering and Convergence Engineering for Intelligent Drone, XR Research Center, Sejong University, Seoul, Korea | [c] Department of Intelligent Mechatronics Engineering, Sejong University, Seoul, Korea

Correspondence: [*] Corresponding authors. Yeong Hyeon Gu, Department of Artificial Intelligence and Data Science, Sejong University, Seoul 05006, Republic of Korea. E-mail: [email protected] and Rizwan Ali Naqvi, Department of Intelligent Mechatronics Engineering, Sejong University, Seoul, Republic of Korea. E-mail: [email protected].

Abstract: BACKGROUND: The emergence of deep learning (DL) techniques has revolutionized tumor detection and classification in medical imaging, with multimodal medical imaging (MMI) gaining recognition for its precision in diagnosis, treatment, and progression tracking. OBJECTIVE: This review comprehensively examines DL methods in transforming tumor detection and classification across MMI modalities, aiming to provide insights into advancements, limitations, and key challenges for further progress. METHODS: Systematic literature analysis identifies DL studies for tumor detection and classification, outlining methodologies including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and their variants. Integration of multimodality imaging enhances accuracy and robustness. RESULTS: Recent advancements in DL-based MMI evaluation methods are surveyed, focusing on tumor detection and classification tasks. Various DL approaches, including CNNs, YOLO, Siamese Networks, Fusion-Based Models, Attention-Based Models, and Generative Adversarial Networks, are discussed with emphasis on PET-MRI, PET-CT, and SPECT-CT. FUTURE DIRECTIONS: The review outlines emerging trends and future directions in DL-based tumor analysis, aiming to guide researchers and clinicians toward more effective diagnosis and prognosis. Continued innovation and collaboration are stressed in this rapidly evolving domain. CONCLUSION: Conclusions drawn from literature analysis underscore the efficacy of DL approaches in tumor detection and classification, highlighting their potential to address challenges in MMI analysis and their implications for clinical practice.

Keywords: Multimodal medical image, deep learning, MRI, CT, PET, fusion, segmentation, image analysis, deep learning, GANs

DOI: 10.3233/XST-230429

Journal: Journal of X-Ray Science and Technology, vol. 32, no. 4, pp. 857-911, 2024