Focused Attention in Transformers for interpretable classification of retinal images.

Med Image Anal

LIV4D, Polytechnique Montréal, 2500 Ch. de Polytechnique, Montréal, QC, H3T 1J4, Canada.

Published: November 2022

Vision Transformers have recently emerged as a competitive architecture in image classification. The tremendous popularity of this model and its variants comes from its high performance and its ability to produce interpretable predictions. However, both of these characteristics remain to be assessed in depth on retinal images. This study proposes a thorough performance evaluation of several Transformers compared to traditional Convolutional Neural Network (CNN) models for retinal disease classification. Special attention is given to multi-modality imaging (fundus and OCT) and generalization to external data. In addition, we propose a novel mechanism to generate interpretable predictions via attribution maps. Existing attribution methods from Transformer models have the disadvantage of producing low-resolution heatmaps. Our contribution, called Focused Attention, uses iterative conditional patch resampling to tackle this issue. By means of a survey involving four retinal specialists, we validated both the superior interpretability of Vision Transformers compared to the attribution maps produced from CNNs and the relevance of Focused Attention as a lesion detector.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.media.2022.102608DOI Listing

Publication Analysis

Top Keywords

focused attention
12
retinal images
8
vision transformers
8
interpretable predictions
8
transformers compared
8
attribution maps
8
transformers
4
attention transformers
4
transformers interpretable
4
interpretable classification
4

Similar Publications

Omega-3 fatty acids: molecular weapons against chemoresistance in breast cancer.

Cell Mol Biol Lett

January 2025

Department of Pharmacy, Health and Nutritional Sciences, University of Calabria, Arcavacata Di Rende, 87036, Cosenza, Italy.

Breast cancer is the most commonly diagnosed type of cancer and the leading cause of cancer-related death in women worldwide. Highly targeted therapies have been developed for different subtypes of breast cancer, including hormone receptor (HR)-positive and human epidermal growth factor receptor 2 (HER2)-positive breast cancer. However, triple-negative breast cancer (TNBC) and metastatic breast cancer disease are primarily treated with chemotherapy, which improves disease-free and overall survival, but does not offer a curative solution for these aggressive forms of breast cancer.

View Article and Find Full Text PDF

Total population for a resource-limited single consumer model.

J Math Biol

January 2025

Department of Integrative Biology, Oklahoma State University, Stillwater, OK, 74078, USA.

In the past several decades, much attention has been focused on the effects of dispersal on total populations of species. In Zhang (EL 20:1118-1128, 2017), a rigorous biological experiment was performed to confirm the mathematical conclusion: Dispersal tends to enhance populations under a suitable hypothesis. In addition, mathematical models keeping track of resource dynamics in population growth were also proposed in Zhang (EL 20:1118-1128, 2017) to understand this remarkable phenomenon.

View Article and Find Full Text PDF

Research progress in the etiology and minimally invasive therapy of hallux valgus.

Surgeon

January 2025

Department of Arthritis, Affiliated Hospital of Shandong Second Medical University, 2428 Yuhe Road, Kuiwen District, Weifang City, Shandong Province, 261031, PR China. Electronic address:

Hallux valgus (HV) is the most common foot deformity. It has various pathogenic factors that make its pathogenesis challenging to understand. As the disease progresses, patients experience amplified pain and decreased activities, significantly affecting their quality of life.

View Article and Find Full Text PDF

Biomarkers and Social Determinants in atherosclerotic Arterial Diseases: A Scoping Review.

Ann Vasc Surg

January 2025

Department of Medical and Surgical Sciences, Magna Graecia University of Catanzaro, 88100, Catanzaro, Italy; Interuniversity Center of Phlebolymphology (CIFL), "Magna Graecia" University, 88100 Catanzaro, Italy. Electronic address:

Background: Arterial diseases like coronary artery disease, carotid stenosis, peripheral artery disease, and abdominal aortic aneurysm have high morbidity and mortality, making them key research areas. Their multifactorial nature complicates patient treatment and prevention. Biomarkers offer insights into the biochemical and molecular processes, while social factors also significantly impact patients' health and quality of life.

View Article and Find Full Text PDF

Levan is a fructan-type homopolysaccharide that has gained increasing attention due to its unique properties and promising applications. It is a fructose-based polymer produced through microbial fermentation by diverse microorganisms, including bacteria, yeasts and archaea. The ongoing research on levan mainly focuses on optimizing production processes, elucidating its biological functions, and uncover novel applications.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!