Multi-task generative adversarial network for retinal optical coherence tomography image denoising.

Phys Med Biol

Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing 100192, People's Republic of China.

Published: February 2023

. Optical coherence tomography (OCT) has become an essential imaging modality for the assessment of ophthalmic diseases. However, speckle noise in OCT images obscures subtle but important morphological details and hampers its clinical applications. In this work, a novel multi-task generative adversarial network (MGAN) is proposed for retinal OCT image denoising.. To strengthen the preservation of retinal structural information in the OCT denoising procedure, the proposed MGAN integrates adversarial learning and multi-task learning. Specifically, the generator of MGAN simultaneously undertakes two tasks, including the denoising task and the segmentation task. The segmentation task aims at the generation of the retinal segmentation map, which can guide the denoising task to focus on the retina-related region based on the retina-attention module. In doing so, the denoising task can enhance the attention to the retinal region and subsequently protect the structural detail based on the supervision of the structural similarity index measure loss.. The proposed MGAN was evaluated and analyzed on three public OCT datasets. The qualitative and quantitative comparisons show that the MGAN method can achieve higher image quality, and is more effective in both speckle noise reduction and structural information preservation than previous denoising methods.. We have presented a MGAN for retinal OCT image denoising. The proposed method provides an effective way to strengthen the preservation of structural information while suppressing speckle noise, and can promote the OCT applications in the clinical observation and diagnosis of retinopathy.

Download full-text PDF

Source
http://dx.doi.org/10.1088/1361-6560/ac944aDOI Listing

Publication Analysis

Top Keywords

image denoising
12
speckle noise
12
denoising task
12
multi-task generative
8
generative adversarial
8
adversarial network
8
optical coherence
8
coherence tomography
8
denoising
8
retinal oct
8

Similar Publications

An L-plug-and-play approach for MPI using a zero shot denoiser with evaluation on the 3D open MPI dataset.

Phys Med Biol

January 2025

Faculty of Mathematics and Natural Sciences , Hochschule Darmstadt, Schöfferstr., 3, Darmstadt, Hessen, 64295, GERMANY.

Magnetic Particle Imaging (MPI) is an emerging medical imaging modality which has gained increasing interest in recent years. Among the benefits of MPI are its high temporal resolution, and that the technique does not expose the specimen to any kind of ionizing radiation. It is based on the non-linear response of magnetic nanoparticles to an applied magnetic field.

View Article and Find Full Text PDF

Introduction: Pests are important factors affecting the growth of cotton, and it is a challenge to accurately detect cotton pests under complex natural conditions, such as low-light environments. This paper proposes a low-light environments cotton pest detection method, DCP-YOLOv7x, based on YOLOv7x, to address the issues of degraded image quality, difficult feature extraction, and low detection precision of cotton pests in low-light environments.

Methods: The DCP-YOLOv7x method first enhances low-quality cotton pest images using FFDNet (Fast and Flexible Denoising Convolutional Neural Network) and the EnlightenGAN low-light image enhancement network.

View Article and Find Full Text PDF

Supervised multi-frame dual-channel denoising enables long-term single-molecule FRET under extremely low photon budget.

Nat Commun

January 2025

State Key Laboratory of Membrane Biology, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing, China.

Camera-based single-molecule techniques have emerged as crucial tools in revolutionizing the understanding of biochemical and cellular processes due to their ability to capture dynamic processes with high precision, high-throughput capabilities, and methodological maturity. However, the stringent requirement in photon number per frame and the limited number of photons emitted by each fluorophore before photobleaching pose a challenge to achieving both high temporal resolution and long observation times. In this work, we introduce MUFFLE, a supervised deep-learning denoising method that enables single-molecule FRET with up to 10-fold reduction in photon requirement per frame.

View Article and Find Full Text PDF

Self-supervised denoising of grating-based phase-contrast computed tomography.

Sci Rep

December 2024

Research Group Biomedical Imaging Physics, Department of Physics, TUM School of Natural Sciences, Technical University of Munich, 85748, Garching, Germany.

Article Synopsis
  • GbPC-CT is gaining popularity for its ability to enhance soft-tissue contrast in imaging, but it struggles with resolution issues, especially at low doses commonly used in clinical settings.
  • The study introduces a self-supervised deep learning model called Noise2Inverse, which helps enhance image quality while reducing the required radiation dose.
  • The results show that Noise2Inverse outperforms traditional denoising methods, indicating that deep learning can improve the resolution of gbPC-CT images, making it a more viable option for medical applications.
View Article and Find Full Text PDF

Purpose: We are developing a three-dimensional X-ray fluorescence computed tomography (3D XFCT) system using non-radioactive-labeled compounds for preclinical studies as a new modality that provides images of biological functions. Improvements in image quality and detection limits are required for the in vivo imaging. The aim of this study was to improve the quality of XFCT images by applying a deep image prior (DIP), which is a type of convolutional neural network, to projection images as a pre-denoising method, and then compare with DIP post-denoising.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!