3D Object Detection Using Multiple-Frame Proposal Features Fusion.

Sensors (Basel)

Defence Research and Development Canada (DRDC), Toronto, ON B3K 5X5, Canada.

Published: November 2023

Object detection is important in many applications, such as autonomous driving. While 2D images lack depth information and are sensitive to environmental conditions, 3D point clouds can provide accurate depth information and a more descriptive environment. However, sparsity is always a challenge in single-frame point cloud object detection. This paper introduces a two-stage proposal-based feature fusion method for object detection using multiple frames. The proposed method, called proposal features fusion (PFF), utilizes a cosine-similarity approach to associate proposals from multiple frames and employs an attention weighted fusion (AWF) module to merge features from these proposals. It allows for feature fusion specific to individual objects and offers lower computational complexity while achieving higher precision. The experimental results on the nuScenes dataset demonstrate the effectiveness of our approach, achieving an mAP of 46.7%, which is 1.3% higher than the state-of-the-art 3D object detection method.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10674697PMC
http://dx.doi.org/10.3390/s23229162DOI Listing

Publication Analysis

Top Keywords

object detection
20
proposal features
8
features fusion
8
feature fusion
8
multiple frames
8
object
5
fusion
5
detection multiple-frame
4
multiple-frame proposal
4
fusion object
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!