The perception module plays an important role in vehicles equipped with advanced driver-assistance systems (ADAS). This paper presents a multi-sensor data fusion system based on the polarization color stereo camera and the forward-looking light detection and ranging (LiDAR), which achieves the multiple target detection, recognition, and data fusion. The You Only Look Once v4 (YOLOv4) network is utilized to achieve object detection and recognition on the color images. The depth images are obtained from the rectified left and right images based on the principle of the epipolar constraints, then the obstacles are detected from the depth images using the MeanShift algorithm. The pixel-level polarization images are extracted from the raw polarization-grey images, then the water hazards are detected successfully. The PointPillars network is employed to detect the objects from the point cloud. The calibration and synchronization between the sensors are accomplished. The experiment results show that the data fusion enriches the detection results, provides high-dimensional perceptual information and extends the effective detection range. Meanwhile, the detection results are stable under diverse range and illumination conditions.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9003213PMC
http://dx.doi.org/10.3390/s22072453DOI Listing

Publication Analysis

Top Keywords

detection recognition
12
data fusion
12
based polarization
8
polarization color
8
color stereo
8
stereo camera
8
depth images
8
detection
7
images
6
unifying obstacle
4

Similar Publications

Multi-class Classification of Retinal Eye Diseases from Ophthalmoscopy Images Using Transfer Learning-Based Vision Transformers.

J Imaging Inform Med

January 2025

College of Engineering, Department of Computer Engineering, Koç University, Rumelifeneri Yolu, 34450, Sarıyer, Istanbul, Turkey.

This study explores a transfer learning approach with vision transformers (ViTs) and convolutional neural networks (CNNs) for classifying retinal diseases, specifically diabetic retinopathy, glaucoma, and cataracts, from ophthalmoscopy images. Using a balanced subset of 4217 images and ophthalmology-specific pretrained ViT backbones, this method demonstrates significant improvements in classification accuracy, offering potential for broader applications in medical imaging. Glaucoma, diabetic retinopathy, and cataracts are common eye diseases that can cause vision loss if not treated.

View Article and Find Full Text PDF

In the present digital scenario, the explosion of Internet of Things (IoT) devices makes massive volumes of high-dimensional data, presenting significant data and privacy security challenges. As IoT networks enlarge, certifying sensitive data privacy while still employing data analytics authority is vital. In the period of big data, statistical learning has seen fast progressions in methodological practical and innovation applications.

View Article and Find Full Text PDF

Nanofluidic iontronics, including the field-effect ionic diode (FE-ID) and field-effect ionic transistor (FE-IT), represent emerging nanofluidic logic devices that have been employed in sensitive analyses. Making analyte recognitions in predefined nanofluidic devices has been verified to improve the sensitivity and selectivity using a single ionic signal, such as ionic current amplification, rectification, and Coulomb blockade. However, the detection of analytes in complex systems generally necessitates more diverse signals beyond just ionic currents.

View Article and Find Full Text PDF

Advanced cortisol detection: A cMWCNTs-enhanced MB@Zr-MOF ratiometric electrochemical aptasensor.

Bioelectrochemistry

January 2025

School of Traditional Chinese Medicine, Capital Medical University, Beijing 100069, China; Laboratory for Clinical Medicine, Capital Medical University, Beijing 100069, China. Electronic address:

A ratiometric electrochemical aptasensor was developed for ultra-sensitive detection of cortisol using aptamer (Apt) as recognition element, methylene blue (MB) as signal probe, and zirconium metal-organic framework (Zr-MOF) as carrier loaded with abundant MB for signal amplification. The carboxylated multi-walled carbon nanotubes (cMWCNTs)-modified Au electrode showed excellent electrochemical performance to immobilize complementary DNA (cDNA) for hybridizing with MB@Zr-MOF-Apt via amide bonds. In the presence of cortisol, it would compete with cDNA for binding the Apt, resulting in the detachment of MB@Zr-MOF-Apt complex from the electrode surface, and the electrochemical signal of MB was decreased, while that of [Fe(CN)] was basically unchanged.

View Article and Find Full Text PDF

A photodetector for red and green with balanced negative and positive photocurrent for imaging is realized.

Sci Rep

January 2025

Guangdong Provincial Key Laboratory of Optical Information Materials and Technology, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou, 510006, People's Republic of China.

A dual-polarity, photovoltaic photodetector for red-green dual-wavelength detection is demonstrated, operating in the self-powered mode. It is based on a core-shell n-InGaN nanowire/p-CuO heterostructure with inner upward energy band bending and near surface downward energy band bending. This produces negative photocurrent for red light illumination and positive photocurrent for green light illumination.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!