Vision transformers: The next frontier for deep learning-based ophthalmic image analysis.

Saudi J Ophthalmol

Department of Ophthalmology, Wilmer Eye Institute, Johns Hopkins University, Baltimore, MD, USA.

Published: July 2023

Deep learning is the state-of-the-art machine learning technique for ophthalmic image analysis, and convolutional neural networks (CNNs) are the most commonly utilized approach. Recently, vision transformers (ViTs) have emerged as a promising approach, one that is even more powerful than CNNs. In this focused review, we summarized studies that applied ViT-based models to analyze color fundus photographs and optical coherence tomography images. Overall, ViT-based models showed robust performances in the grading of diabetic retinopathy and glaucoma detection. While some studies demonstrated that ViTs were superior to CNNs in certain contexts of use, it is unclear how widespread ViTs will be adopted for ophthalmic image analysis, since ViTs typically require even more training data as compared to CNNs. The studies included were identified from the PubMed and Google Scholar databases using keywords relevant to this review. Only original investigations through March 2023 were included.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10701151PMC
http://dx.doi.org/10.4103/sjopt.sjopt_91_23DOI Listing

Publication Analysis

Top Keywords

ophthalmic image
12
image analysis
12
vision transformers
8
vit-based models
8
transformers frontier
4
frontier deep
4
deep learning-based
4
learning-based ophthalmic
4
analysis deep
4
deep learning
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!