Using open surgery simulation kinematic data for tool and gesture recognition.

Int J Comput Assist Radiol Surg

Faculty of Industrial Engineering and Management, Technion - Israel Institute of Technology, 3200003, Haifa, Israel.

Published: June 2022

Purpose: The use of motion sensors is emerging as a means for measuring surgical performance. Motion sensors are typically used for calculating performance metrics and assessing skill. The aim of this study was to identify surgical gestures and tools used during an open surgery suturing simulation based on motion sensor data.

Methods: Twenty-five participants performed a suturing task on a variable tissue simulator. Electromagnetic motion sensors were used to measure their performance. The current study compares GRU and LSTM networks, which are known to perform well on other kinematic datasets, as well as MS-TCN++, which was developed for video data and was adapted in this work for motion sensors data. Finally, we extended all architectures for multi-tasking.

Results: In the gesture recognition task the MS-TCN++ has the highest performance with accuracy of [Formula: see text] and F1-Macro of [Formula: see text], edit distance of [Formula: see text] and F1@10 of [Formula: see text] In the tool usage recognition task for the right hand, MS-TCN++ performs the best in most metrics with an accuracy score of [Formula: see text], F1-Macro of [Formula: see text], F1@10 of [Formula: see text], and F1@25 of [Formula: see text]. The multi-task GRU performs best in all metrics in the left-hand case, with an accuracy of [Formula: see text], edit distance of [Formula: see text], F1-Macro of [Formula: see text], F1@10 of [Formula: see text], and F1@25 of [Formula: see text].

Conclusion: In this study, using motion sensor data, we automatically identified the surgical gestures and the tools used during an open surgery suturing simulation. Our methods may be used for computing more detailed performance metrics and assisting in automatic workflow analysis. MS-TCN++ performed better in gesture recognition as well as right-hand tool recognition, while the multi-task GRU provided better results in the left-hand case. It should be noted that our multi-task GRU network is significantly smaller and has achieved competitive results in the rest of the tasks as well.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10766114PMC
http://dx.doi.org/10.1007/s11548-022-02615-1DOI Listing

Publication Analysis

Top Keywords

[formula text]
48
motion sensors
16
[formula
13
open surgery
12
gesture recognition
12
text]
12
text] f1-macro
12
f1-macro [formula
12
text] f1@10
12
f1@10 [formula
12

Similar Publications

The following paper presents the findings of a study conducted on the distances at which the field generated by a ϕ-symmetric circular Taylor aperture distribution can be classified as far-field, and also the efficiency across various study parameters. The [Formula: see text] transition integers that produce a monotonic distribution, which have been traditionally used and analyzed, are compared with those that yield a peaked distribution, and offer greater efficiency. Additionally, modified circular Taylor [Formula: see text] distributions featuring synthesized patterns with one or two depressed inner sidelobes, which have not been previously explored, are also examined.

View Article and Find Full Text PDF

Background: We sought to define whether and how hepatic ischemia/reperfusion (I/R) as manifested by perioperative aspartate aminotransferase (AST) and alanine aminotransaminase (ALT) levels impact long-term outcomes after curative-intent resection of hepatocellular carcinoma (HCC).

Patients And Methods: Intrasplenic injection of HCC cells was used to establish a murine model of HCC recurrence with versus without I/R injury. Patients who underwent curative resection for HCC were identified from a multi-institutional derivative cohort (DC) and separate external validation (VC) cohort.

View Article and Find Full Text PDF

Trains scheduling problem with multiple lines.

Sci Rep

December 2024

Department of Mathematics, School of Advanced Sciences, Vellore Institute of Technology, Vellore, Tamil Nadu, 632014, India.

This study explores the problem of train scheduling (or) train timetabling and its impact on the administration of railway management. This is a highly dependable and effective public transportation system. The problem considers both single and multiple tracks along with multiple platforms with varying train capacities (like speed, passengers, and so on).

View Article and Find Full Text PDF

Mathematical analysis of fractional Chlamydia pandemic model.

Sci Rep

December 2024

Department of Mathematics, Faculty of Science, The Hashemite University, P.O.Box 330127, Zarqa, 13133, Jordan.

In this study, we developed a Caputo-Fractional Chlamydia pandemic model to describe the disease's spread. We demonstrated the model's positivity and boundedness, ensuring biological relevance. The existence and uniqueness of the model's solution were established, and we investigated the stability of the α-fractional order model.

View Article and Find Full Text PDF

Artificial intelligence (AI) provides considerable opportunities to assist human work. However, one crucial challenge of human-AI collaboration is that many AI algorithms operate in a black-box manner where the way how the AI makes predictions remains opaque. This makes it difficult for humans to validate a prediction made by AI against their own domain knowledge.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!