Electron microscopy (EM) image denoising is critical for visualization and subsequent analysis. Despite the remarkable achievements of deep learning-based non-blind denoising methods, their performance drops significantly when domain shifts exist between the training and testing data. To address this issue, unpaired blind denoising methods have been proposed. However, these methods heavily rely on image-to-image translation and neglect the inherent characteristics of EM images, limiting their overall denoising performance. In this paper, we propose the first unsupervised domain adaptive EM image denoising method, which is grounded in the observation that EM images from similar samples share common content characteristics. Specifically, we first disentangle the content representations and the noise components from noisy images and establish a shared domain-agnostic content space via domain alignment to bridge the synthetic images (source domain) and the real images (target domain). To ensure precise domain alignment, we further incorporate domain regularization by enforcing that: the pseudo-noisy images, reconstructed using both content representations and noise components, accurately capture the characteristics of the noisy images from which the noise components originate, all while maintaining semantic consistency with the noisy images from which the content representations originate. To guarantee lossless representation decomposition and image reconstruction, we introduce disentanglement-reconstruction invertible networks. Finally, the reconstructed pseudo-noisy images, paired with their corresponding clean counterparts, serve as valuable training data for the denoising network. Extensive experiments on synthetic and real EM datasets demonstrate the superiority of our method in terms of image restoration quality and downstream neuron segmentation accuracy. Our code is publicly available at https://github.com/sydeng99/DADn.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TMI.2024.3431192DOI Listing

Publication Analysis

Top Keywords

image denoising
12
content representations
12
noise components
12
noisy images
12
images
9
unsupervised domain
8
invertible networks
8
denoising methods
8
representations noise
8
domain alignment
8

Similar Publications

Patch-based dual-domain photon-counting CT data correction with residual-based WGAN-ViT.

Phys Med Biol

January 2025

Electrical and Computer Engineering, University of Massachusetts Lowell, Ball Hall, 1 University Ave, Lowell, Massachusetts, 01854, UNITED STATES.

Objective: X-ray photon-counting detectors (PCDs) have recently gained popularity due to their capabilities in energy discrimination power, noise suppression, and resolution refinement. The latest extremity photon-counting computed tomography (PCCT) scanner leverages these advantages for tissue characterization, material decomposition, beam hardening correction, and metal artifact reduction. However, technical challenges such as charge splitting and pulse pileup can distort the energy spectrum and compromise image quality.

View Article and Find Full Text PDF

Background: The success of embolization, a minimally invasive treatment of liver cancer, could be evaluated in the operational room with cone-beam CT by acquiring a dynamic perfusion scan to inspect the contrast agent flow.

Purpose: The reconstruction algorithm must address the issues of low temporal sampling and higher noise levels inherent in cone-beam CT systems, compared to conventional CT.

Methods: Therefore, a model-based perfusion reconstruction based on the time separation technique (TST) was applied.

View Article and Find Full Text PDF

To improve the performance of Radio Frequency Identification (RFID) multi-label systems, the multi-label network structure needs to be quickly located and optimized. A multi-label location measurement method based on the NLM-Harris algorithm is proposed in this paper. Firstly, multi-label geometric distribution images are obtained through a label image acquisition system of a multi-label semi-physical simulation platform with two vertical Charge-Coupled Device (CCD) cameras, and Gaussian noise is added to the image to simulate thermoelectric interference.

View Article and Find Full Text PDF

Dual-Modal Approach for Ship Detection: Fusing Synthetic Aperture Radar and Optical Satellite Imagery.

Sensors (Basel)

January 2025

Department of Electrical and Software Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada.

The fusion of synthetic aperture radar (SAR) and optical satellite imagery poses significant challenges for ship detection due to the distinct characteristics and noise profiles of each modality. Optical imagery provides high-resolution information but struggles in adverse weather and low-light conditions, reducing its reliability for maritime applications. In contrast, SAR imagery excels in these scenarios but is prone to noise and clutter, complicating vessel detection.

View Article and Find Full Text PDF

A Parallel Image Denoising Network Based on Nonparametric Attention and Multiscale Feature Fusion.

Sensors (Basel)

January 2025

School of Electronic and Information Engineering, Ankang University, Ankang 725000, China.

Convolutional neural networks have achieved excellent results in image denoising; however, there are still some problems: (1) The majority of single-branch models cannot fully exploit the image features and often suffer from the loss of information. (2) Most of the deep CNNs have inadequate edge feature extraction and saturated performance problems. To solve these problems, this paper proposes a two-branch convolutional image denoising network based on nonparametric attention and multiscale feature fusion, aiming to improve the denoising performance while better recovering the image edge and texture information.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!