Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation.

Int J Comput Assist Radiol Surg

Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China.

Published: May 2024

Purpose: The healthcare industry has a growing need for realistic modeling and efficient simulation of surgical scenes. With effective models of deformable surgical scenes, clinicians are able to conduct surgical planning and surgery training on scenarios close to real-world cases. However, a significant challenge in achieving such a goal is the scarcity of high-quality soft tissue models with accurate shapes and textures. To address this gap, we present a data-driven framework that leverages emerging neural radiance field technology to enable high-quality surgical reconstruction and explore its application for surgical simulations.

Method: We first focus on developing a fast NeRF-based surgical scene 3D reconstruction approach that achieves state-of-the-art performance. This method can significantly outperform traditional 3D reconstruction methods, which have failed to capture large deformations and produce fine-grained shapes and textures. We then propose an automated creation pipeline of interactive surgical simulation environments through a closed mesh extraction algorithm.

Results: Our experiments have validated the superior performance and efficiency of our proposed approach in surgical scene 3D reconstruction. We further utilize our reconstructed soft tissues to conduct FEM and MPM simulations, showcasing the practical application of our method in data-driven surgical simulations.

Conclusion: We have proposed a novel NeRF-based reconstruction framework with an emphasis on simulation purposes. Our reconstruction framework facilitates the efficient creation of high-quality surgical soft tissue 3D models. With multiple soft tissue simulations demonstrated, we show that our work has the potential to benefit downstream clinical tasks, such as surgical education.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11098936PMC
http://dx.doi.org/10.1007/s11548-024-03114-1DOI Listing

Publication Analysis

Top Keywords

surgical
12
soft tissue
12
data-driven surgical
8
surgical simulation
8
surgical scenes
8
tissue models
8
shapes textures
8
high-quality surgical
8
surgical scene
8
scene reconstruction
8

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!