This study presents a real-time sensor fusion framework based on the extended Kalman filter (EKF) for accurate and robust endomicroscopic image mosaicking. The sensor fusion framework incorporates an optical tracking system that can track 6-DOF pose of the imaging probe with high accuracy in real time in conjunction with 2D local image registration from image feature matching between two consecutive frames. We evaluated the performance of the real-time image mosaicking based on the sensor fusion compared with the image or tracker only approach. As a result, it could retain the microscopic level of image detail from the image-based approach and also achieve a robust image mosaic without any drift by using the accurate optical tracking system.

Download full-text PDF

Source
http://dx.doi.org/10.1109/EMBC40787.2023.10340903DOI Listing

Publication Analysis

Top Keywords

sensor fusion
16
image mosaicking
12
image
8
endomicroscopic image
8
fusion framework
8
optical tracking
8
tracking system
8
real-time endomicroscopic
4
mosaicking ekf-based
4
sensor
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!