Multimodal deep learning approaches for precision oncology: a comprehensive review.

Brief Bioinform

Department of Nephrology, Xuanwu Hospital, Capital Medical University, Changchun Street, Xicheng District, Beijing 100053, China.

Published: November 2024

The burgeoning accumulation of large-scale biomedical data in oncology, alongside significant strides in deep learning (DL) technologies, has established multimodal DL (MDL) as a cornerstone of precision oncology. This review provides an overview of MDL applications in this field, based on an extensive literature survey. In total, 651 articles published before September 2024 are included. We first outline publicly available multimodal datasets that support cancer research. Then, we discuss key DL training methods, data representation techniques, and fusion strategies for integrating multimodal data. The review also examines MDL applications in tumor segmentation, detection, diagnosis, prognosis, treatment selection, and therapy response monitoring. Finally, we critically assess the limitations of current approaches and propose directions for future research. By synthesizing current progress and identifying challenges, this review aims to guide future efforts in leveraging MDL to advance precision oncology.

Download full-text PDF

Source
http://dx.doi.org/10.1093/bib/bbae699DOI Listing
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11700660PMC

Publication Analysis

Top Keywords

precision oncology
12
deep learning
8
mdl applications
8
multimodal
4
multimodal deep
4
learning approaches
4
approaches precision
4
oncology
4
oncology comprehensive
4
review
4

Similar Publications

Visualizing the Tumor Microenvironment: Molecular Imaging Probes Target Extracellular Matrix, Vascular Networks, and Immunosuppressive Cells.

Pharmaceuticals (Basel)

December 2024

Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, No. 155, Sec. 2, Li-Nong St., Beitou Dist., Taipei City 112, Taiwan.

The tumor microenvironment (TME) is a critical factor in cancer progression, driving tumor growth, immune evasion, therapeutic resistance, and metastasis. Understanding the dynamic interactions within the TME is essential for advancing cancer management. Molecular imaging provides a non-invasive, real-time, and longitudinal approach to studying the TME, with techniques such as positron emission tomography (PET), magnetic resonance imaging (MRI), and fluorescence imaging offering complementary strengths, including high sensitivity, spatial resolution, and intraoperative precision.

View Article and Find Full Text PDF

Urachal cancer (UrC) is a rare disease which is mostly diagnosed late due to symptoms caused by its local invasion to the urinary bladder. Given the lack of clinical trials and guideline recommendations for systemic treatment, a molecularly informed precision oncology approach is a viable option for UrC already in the early lines of systemic treatment. While single case experiences may provide valuable reference for later decision-making, well-documented clinical experience with off-label targeted treatments is limited to a few patients.

View Article and Find Full Text PDF

Epidemiology of Rounding Error.

Medicina (Kaunas)

December 2024

Cooperative Studies Program Coordinating Center, VA Boston, Lafayette City Center, 2 Avenue de Lafayette, Boston, MA 02111, USA.

This work represents a significant contribution to understanding the importance of appropriately rounding numbers with minimal error. That is, to reduce inexact rounding and data truncation error and simultaneously eliminate unintentional misleading findings in epidemiological studies. The rounding of numbers represents a compromise solution that attempts to find a balance between the loss of information from reporting too few significant digits versus retaining more digits than necessary.

View Article and Find Full Text PDF

Tumor heterogeneity is a significant factor influencing cancer treatment effectiveness and can arise from genetic, epigenetic, and phenotypic variations among cancer cells. Understanding how tumor heterogeneity impacts tumor evolution and therapy response can lead to more effective treatments and improved patient outcomes. Traditional bulk genomic approaches fail to provide insights into cellular-level events, whereas single-cell RNA sequencing (scRNA-seq) offers transcriptomic analysis at the individual cell level, advancing our understanding of tumor growth, progression, and drug response.

View Article and Find Full Text PDF

A Dual-Branch Residual Network with Attention Mechanisms for Enhanced Classification of Vaginal Lesions in Colposcopic Images.

Bioengineering (Basel)

November 2024

Department of Obstetrics and Gynecology, Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai 200030, China.

Vaginal intraepithelial neoplasia (VAIN), linked to HPV infection, is a condition that is often overlooked during colposcopy, especially in the vaginal vault area, as clinicians tend to focus more on cervical lesions. This oversight can lead to missed or delayed diagnosis and treatment for patients with VAIN. Timely and accurate classification of VAIN plays a crucial role in the evaluation of vaginal lesions and the formulation of effective diagnostic approaches.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!