Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction.

Sensors (Basel)

School of Computing, Gachon University, Seongnam 13120, Korea.

Published: September 2022

High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR contents. Depending on a single attention mechanism or alignment causes failure in compensating ghosting artifacts, which can arise in the synthesized HDR images due to the motion of objects or camera movement across different LDR image inputs. In this study, we propose a multi-scale attention-guided non-local network called MSANLnet for efficient HDR image reconstruction. To mitigate the ghosting artifacts, the proposed MSANLnet performs implicit alignment of LDR image features with multi-scale spatial attention modules and then reconstructs pixel intensity values using long-range dependencies through non-local means-based fusion. These modules adaptively select useful information that is not damaged by an object's movement or unfavorable lighting conditions for image pixel fusion. Quantitative evaluations against several current state-of-the-art methods show that the proposed approach achieves higher performance than the existing methods. Moreover, comparative visual results show the effectiveness of the proposed method in restoring saturated information from original input images and mitigating ghosting artifacts caused by large movement of objects. Ablation studies show the effectiveness of the proposed method, architectural choices, and modules for efficient HDR reconstruction.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9503481PMC
http://dx.doi.org/10.3390/s22187044DOI Listing

Publication Analysis

Top Keywords

hdr image
16
image reconstruction
12
ghosting artifacts
12
multi-scale attention-guided
8
attention-guided non-local
8
non-local network
8
ldr images
8
ldr image
8
efficient hdr
8
effectiveness proposed
8

Similar Publications

Aims: To assess the reproducibility of 4D-Flow cardiac magnetic resonance (CMR) parameters in the descending thoracic aorta-DTAo-(regurgitant fraction [RF], end-diastolic reverse flow [EDRF], and holodiastolic flow reversal [HDR]), and the relationship with RF in the sinotubular junction (STJ), and the left ventricular end-diastolic volume index (LVEDVI) in patients with chronic aortic regurgitation (AR).

Methods And Results: A descriptive study of these variables was conducted. A receiver operating characteristic curve was used to determine the optimal cut-off point.

View Article and Find Full Text PDF

Digital Mini-LED Lighting Using Organic Thin-Film Transistors Reaching over 100,000 Nits of Luminance.

Nanomaterials (Basel)

January 2025

Department of Photonics, College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan.

This paper demonstrates the use of organic thin-film transistors (OTFTs) to drive active digital mini light-emitting diode (mini-LED) backlights, aiming to achieve exceptional display performance. Our findings reveal that OTFTs can effectively power mini-LED backlights, reaching brightness levels exceeding 100,000 nits. This approach not only enhances image quality but also improves energy efficiency.

View Article and Find Full Text PDF

RGGB sensor arrays are commonly used in digital cameras and mobile photography. However, images of extreme dark-light conditions often suffer from insufficient exposure because the sensor receives insufficient light. The existing methods mainly employ U-Net variants, multi-stage camera parameter simulation, or image parameter processing to address this issue.

View Article and Find Full Text PDF

Introduction: Current brain-based visual prostheses pose significant challenges impeding adoption such as the necessarily complex surgeries and occurrence of more substantial side effects due to the sensitivity of the brain. This has led to much effort toward vision restoration being focused on the more approachable part of the brain - the retina. Here we introduce a novel, parameterized simulation platform that enables study of human retinal degeneration and optimization of stimulation strategies.

View Article and Find Full Text PDF

The choroid, a critical vascular layer beneath the retina, is essential for maintaining retinal function and monitoring chorioretinal disorders. Existing imaging methods, such as indocyanine green angiography (ICGA) and optical coherence tomography (OCT), face significant limitations, including contrast agent requirements, restricted field of view (FOV), and high costs, limiting accessibility. To address these challenges, we developed a nonmydriatic, contrast agent-free fundus camera utilizing transcranial near-infrared (NIR) illumination.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!