We propose Pixel2Pixel, a novel zero-shot image denoising framework that leverages the non-local self-similarity of images to generate a large number of training samples using only the input noisy image. This framework employs a compact convolutional neural network architecture to achieve high-quality image denoising. Given a single observed noisy image, we first aim to obtain multiple images with different noise versions. We ensure that the content remains as consistent as possible with the true signal of the noisy image while keeping the noise independent. Specifically, we construct a pixel bank tensor, where each pixel consists of the most similar pixels from the non-local region of the noisy image. Then, multiple training samples, also known as pseudo instances, can be derived from the pixel bank by randomly pixel sampling. By harnessing pixel- wise random sampling, Pixel2Pixel generates a large number of training pseudo instances, thus avoiding reliance on specific training data. In addition, this non-local pixel selection and random sampling strategy helps to break down the spatial correlation of real-world noise as well. Since the proposed method does not require accurate priors on the noise distribution and clean training images, it is suitable for a wide range of noise types and different noise levels, exhibiting strong generalization ability, especially in real noisy scenes. Extensive experiments across various noise types show that Pixel2Pixel outperforms existing methods. The code is available at https://github.com/qingma2016/Pixel2Pixel.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TPAMI.2025.3546870DOI Listing

Publication Analysis

Top Keywords

noisy image
16
image denoising
12
large number
8
number training
8
training samples
8
pixel bank
8
pseudo instances
8
random sampling
8
noise types
8
image
7

Similar Publications

Background: Diabetic retinopathy (DR) is a leading cause of visual impairment and blindness worldwide, necessitating early detection and accurate diagnosis. This study proposes a novel framework integrating Generative Adversarial Networks (GANs) for data augmentation, denoising autoencoders for noise reduction, and transfer learning with EfficientNetB0 to enhance the performance of DR classification models.

Methods: GANs were employed to generate high-quality synthetic retinal images, effectively addressing class imbalance and enriching the training dataset.

View Article and Find Full Text PDF

Recently, contrast-enhanced ultrasound (CEUS) has presented a potential value in the diagnosis of liver trauma, the leading cause of death in blunt abdominal trauma. However, the inherent speckle noise and the complicated visual characteristics of blunt liver trauma in CEUS images make the diagnosis highly dependent on the expertise of radiologists, which is subjective and time-consuming. Moreover, the intra- and inter-observer variance inevitably influences the accuracy of diagnosis using CEUS.

View Article and Find Full Text PDF

Automatic processing and full analysis of in situ liquid phase scanning transmission electron microscopy (LP-STEM) acquisitions are yet to be achievable with available techniques. This is particularly true for the extraction of information related to the nucleation and growth of nanoparticles (NPs) in liquid as several parasitic processes degrade the signal of interest. These degradations hinder the use of classical or state-of-the-art techniques making the understanding of NPs formation difficult to access.

View Article and Find Full Text PDF

Alzheimer's Disease Prediction Using 3D-CNNs: Intelligent Processing of Neuroimaging Data.

SLAS Technol

March 2025

Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Alkharj 11942, Saudi Arabia.

Alzheimer's disease (AD) is a severe neurological illness that demolishes memory and brain functioning. This disease affects an individual's capacity to work, think, and behave. The proportion of individuals suffering from AD is rapidly increasing.

View Article and Find Full Text PDF

Neural correlates of uncertainty processing in psychosis spectrum disorder.

Brain Commun

February 2025

Department of Psychiatry and Neuroscience, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, CCM, Berlin 10117, Germany.

Psychotic beliefs are typically held with high certainty. Altered computation of uncertainty about a belief and about environmental dynamics may be an underlying mechanism of psychotic symptoms. We set out to shed light on behavioural and neural correlates of uncertainty processing and how it drives belief updating in psychosis.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!