Potential auto-driving threat: Universal rain-removal attack.

iScience

Department of Aeronautical and Automotive Engineering, Loughborough University, Leicestershire LE11 3TU UK.

Published: September 2023

Severe weather conditions pose a significant challenge for computer vision algorithms in autonomous driving applications, particularly regarding robustness. Image rain-removal algorithms have emerged as a potential solution by leveraging the power of neural networks to restore rain-free backgrounds in images. However, existing research overlooks the vulnerability concerns in neural networks, which exposes a potential threat to the intelligent perception of autonomous vehicles in rainy conditions. This paper proposes a universal rain-removal attack (URA) that exploits the vulnerability of image rain-removal algorithms. By generating a non-additive spatial perturbation, URA significantly diminishes scene restoration similarity and image quality. The imperceptible and generic perturbation employed by URA makes it a crucial tool for vulnerability detection in image rain-removal algorithms and a potential real-world AI attack method. Experimental results demonstrate that URA can reduce scene repair capability by 39.5% and image generation quality by 26.4%, effectively targeting state-of-the-art rain-removal algorithms.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10448019PMC
http://dx.doi.org/10.1016/j.isci.2023.107393DOI Listing

Publication Analysis

Top Keywords

rain-removal algorithms
16
image rain-removal
12
universal rain-removal
8
rain-removal attack
8
neural networks
8
rain-removal
6
algorithms
5
image
5
potential
4
potential auto-driving
4

Similar Publications

Potential auto-driving threat: Universal rain-removal attack.

iScience

September 2023

Department of Aeronautical and Automotive Engineering, Loughborough University, Leicestershire LE11 3TU UK.

Severe weather conditions pose a significant challenge for computer vision algorithms in autonomous driving applications, particularly regarding robustness. Image rain-removal algorithms have emerged as a potential solution by leveraging the power of neural networks to restore rain-free backgrounds in images. However, existing research overlooks the vulnerability concerns in neural networks, which exposes a potential threat to the intelligent perception of autonomous vehicles in rainy conditions.

View Article and Find Full Text PDF

Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use of the powerful representation and fitting abilities of deep learning to complete low-level visual tasks.

View Article and Find Full Text PDF

Progressive Rain Removal Based on the Combination Network of CNN and Transformer.

Comput Intell Neurosci

October 2022

Intelligent Manufacturing Electronics Research Center, Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100083, China.

The rain removal method based on CNN develops rapidly. However, convolution operation has the disadvantages of limited receptive field and inadaptability to the input content. Recently, another neural network structure Transformer has shown excellent performance in natural language processing and advanced visual tasks by modeling global relationships, but Transformer has limitations in capturing local dependencies.

View Article and Find Full Text PDF

Scale-Space Feature Recalibration Network for Single Image Deraining.

Sensors (Basel)

September 2022

School of Information Science and Engineering, Dalian Polytechnic University, Dalian 116034, China.

Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information.

View Article and Find Full Text PDF

Video Desnowing and Deraining via Saliency and Dual Adaptive Spatiotemporal Filtering.

Sensors (Basel)

November 2021

Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland 1020, New Zealand.

Outdoor vision sensing systems often struggle with poor weather conditions, such as snow and rain, which poses a great challenge to existing video desnowing and deraining methods. In this paper, we propose a novel video desnowing and deraining model that utilizes the salience information of moving objects to address this problem. First, we remove the snow and rain from the video by low-rank tensor decomposition, which makes full use of the spatial location information and the correlation between the three channels of the color video.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!