EWT: Efficient Wavelet-Transformer for single image denoising.

Neural Netw

Department of Mathematics, The Chinese University of Hong Kong, New Territories, 999077, Hong Kong, China. Electronic address:

Published: September 2024

Transformer-based image denoising methods have shown remarkable potential but suffer from high computational cost and large memory footprint due to their linear operations for capturing long-range dependencies. In this work, we aim to develop a more resource-efficient Transformer-based image denoising method that maintains high performance. To this end, we propose an Efficient Wavelet Transformer (EWT), which incorporates a Frequency-domain Conversion Pipeline (FCP) to reduce image resolution without losing critical features, and a Multi-level Feature Aggregation Module (MFAM) with a Dual-stream Feature Extraction Block (DFEB) to harness hierarchical features effectively. EWT achieves a faster processing speed by over 80% and reduces GPU memory usage by more than 60% compared to the original Transformer, while still delivering denoising performance on par with state-of-the-art methods. Extensive experiments show that EWT significantly improves the efficiency of Transformer-based image denoising, providing a more balanced approach between performance and resource consumption.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.106378DOI Listing

Publication Analysis

Top Keywords

image denoising
16
transformer-based image
12
image
5
denoising
5
ewt
4
ewt efficient
4
efficient wavelet-transformer
4
wavelet-transformer single
4
single image
4
denoising transformer-based
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!