Novel multimodal sensing and machine learning strategies to classify cognitive workload in laparoscopic surgery.

Background: Surgeons can experience elevated cognitive workload (CWL) during surgery due to various factors including operative technicalities and the environmental demands of the operating theatre. This can result in poorer outcomes and have a detrimental effect on surgeon well-being. The objective measurement of CWL provides a potential solution to facilitate classification of workload levels, however results are variable when physiological measures are used in isolation.

A snapshot audit of global flexible endoscopy practice among European Association of Endoscopic Surgeons (EAES) and Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) surgeons from the EAES Flexible Endoscopy Subcommittee survey.

Introduction: Endoscopy is an essential skill for all surgeons. However, endoscopic competency, training, and practice may vary widely among them. The EAES Flexible Endoscopy Subcommittee is working towards a standardized set of fundamental endoscopic knowledge and skills.

Development and validation of a virtual teaching method for minimally invasive surgery skills: a prospective cohort study.

Introduction: The COVID-19 pandemic led to a significant reduction in operative exposure for surgical trainees, necessitating alternative training methods to mitigate the impact on surgical education. This study sought to evaluate whether minimally invasive surgery (MIS) skills could be taught remotely using widely available technology with objective assessments of proficiency.

Methods: This was a pilot observational study with comparative assessment of face-to-face (F2F) and virtual training of novice learners in MIS skills.

Tissue palpation in endoscopy using EIT and soft actuators.

The integration of soft robots in medical procedures has significantly improved diagnostic and therapeutic interventions, addressing safety concerns and enhancing surgeon dexterity. In conjunction with artificial intelligence, these soft robots hold the potential to expedite autonomous interventions, such as tissue palpation for cancer detection. While cameras are prevalent in surgical instruments, situations with obscured views necessitate palpation.

Eye-controlled endoscopy - a benchtop trial of a novel robotic steering platform - iGAZE2.

The endoscopic control system has remained similar in design for many decades The remit of advanced therapeutic endoscopy continues to expand requiring precision control and high cognitive workloads. Robotic systems are emerging, but all still require bimanual control and expensive and large new systems. Eye tracking is an exciting area that can be used as an endoscope control system.

Objective Assessment of Cognitive Workload in Surgery: A Systematic Review.

Objective: To systematically review technologies that objectively measure CWL in surgery, assessing their psychometric and methodological characteristics.

Summary Background Data: Surgical tasks involving concurrent clinical decision-making and the safe application of technical and non-technical skills require a substantial cognitive demand and resource utilization. Cognitive overload leads to impaired clinical decision-making and performance decline.

A Tension Sensor Array for Cable-Driven Surgical Robots.

Tendon-sheath structures are commonly utilized to drive surgical robots due to their compact size, flexibility, and straightforward controllability. However, long-distance cable tension estimation poses a significant challenge due to its frictional characteristics affected by complicated factors. This paper proposes a miniature tension sensor array for an endoscopic cable-driven parallel robot, aiming to integrate sensors into the distal end of long and flexible surgical instruments to sense cable tension and alleviate friction between the tendon and sheath.

Telestration with augmented reality improves surgical performance through gaze guidance.

Background: In minimally invasive surgery (MIS), trainees need to learn how to interpret the operative field displayed on the laparoscopic screen. Experts currently guide trainees mainly verbally during laparoscopic procedures. A newly developed telestration system with augmented reality (iSurgeon) allows the instructor to display hand gestures in real-time on the laparoscopic screen in augmented reality to provide visual expert guidance (telestration).

Eye tracking technology in endoscopy: Looking to the future.

The visual patterns of an endoscopist, that is, what the endoscopist is looking at during luminal endoscopy, is an interesting area with an evolving evidence base. The tools required for gaze analysis have become cheaper and more easily accessible. A comprehensive literature search was undertaken identifying 19 relevant papers.

The Measurement of Cognitive Workload in Surgery Using Pupil Metrics: A Systematic Review and Narrative Analysis.

Introduction: Increased cognitive workload (CWL) is a well-established entity that can impair surgical performance and increase the likelihood of surgical error. The use of pupil and gaze tracking data is increasingly being used to measure CWL objectively in surgery. The aim of this review is to summarize and synthesize the existing evidence that surrounds this.

An eye-tracking based robotic scrub nurse: proof of concept.

Background: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a "third hand" to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) in a simulated operating room based on a novel real-time framework for theatre-wide 3D gaze localization in a mobile fashion.

A novel gaze-controlled flexible robotized endoscope; preliminary trial and report.

Background: Interventional endoluminal therapy is rapidly advancing as a minimally invasive surgical technique. The expanding remit of endoscopic therapy necessitates precision control. Eye tracking is an emerging technology which allows intuitive control of devices.

Tool-tissue forces in surgery: A systematic review.

Background: Excessive tool-tissue interaction forces often result in tissue damage and intraoperative complications, while insufficient forces prevent the completion of the task. This review sought to explore the tool-tissue interaction forces exerted by instruments during surgery across different specialities, tissues, manoeuvres and experience levels.

Materials & Methods: A PRISMA-guided systematic review was carried out using Embase, Medline and Web of Science databases.

Deployable, Variable Stiffness, Cable Driven Robot for Minimally Invasive Surgery.

Minimally Invasive Surgery (MIS) imposes a trade-off between non-invasive access and surgical capability. Treatment of early gastric cancers over 20 mm in diameter can be achieved by performing Endoscopic Submucosal Dissection (ESD) with a flexible endoscope; however, this procedure is technically challenging, suffers from extended operation times and requires extensive training. To facilitate the ESD procedure, we have created a deployable cable driven robot that increases the surgical capabilities of the flexible endoscope while attempting to minimize the impact on the access that they offer.

Haptic Intracorporeal Palpation Using a Cable-Driven Parallel Robot: A User Study.

Objective: Intraoperative palpation is a surgical gesture jeopardized by the lack of haptic feedback which affects robotic minimally invasive surgery. Restoring the force reflection in teleoperated systems may improve both surgeons' performance and procedures' outcome.

Methods: A force-based sensing approach was developed, based on a cable-driven parallel manipulator with anticipated seamless and low-cost integration capabilities in teleoperated robotic surgery.

Next-generation robotics in gastrointestinal surgery.

The global numbers of robotic gastrointestinal surgeries are increasing. However, the evidence base for robotic gastrointestinal surgery does not yet support its widespread adoption or justify its cost. The reasons for its continued popularity are complex, but a notable driver is the push for innovation - robotic surgery is seen as a compelling solution for delivering on the promise of minimally invasive precision surgery - and a changing commercial landscape delivers the promise of increased affordability.

Soft Robotics in Minimally Invasive Surgery.

Soft robotic devices have desirable traits for applications in minimally invasive surgery (MIS), but many interdisciplinary challenges remain unsolved. To understand current technologies, we carried out a keyword search using the Web of Science and Scopus databases, applied inclusion and exclusion criteria, and compared several characteristics of the soft robotic devices for MIS in the resulting articles. There was low diversity in the device designs and a wide-ranging level of detail regarding their capabilities.

A cable-driven parallel manipulator with force sensing capabilities for high-accuracy tissue endomicroscopy.

Purpose: Endomicroscopy (EM) provides high resolution, non-invasive histological tissue information and can be used for scanning of large areas of tissue to assess cancerous and pre-cancerous lesions and their margins. However, current robotic solutions do not provide the accuracy and force sensitivity required to perform safe and accurate tissue scanning.

Methods: A new surgical instrument has been developed that uses a cable-driven parallel mechanism (CPDM) to manipulate an EM probe.

Gaze-contingent perceptually enabled interactions in the operating theatre.

Purpose: Improved surgical outcome and patient safety in the operating theatre are constant challenges. We hypothesise that a framework that collects and utilises information -especially perceptually enabled ones-from multiple sources, could help to meet the above goals. This paper presents some core functionalities of a wider low-cost framework under development that allows perceptually enabled interaction within the surgical environment.

The impact of expert visual guidance on trainee visual search strategy, visual attention and motor skills.

Minimally invasive and robotic surgery changes the capacity for surgical mentors to guide their trainees with the control customary to open surgery. This neuroergonomic study aims to assess a "Collaborative Gaze Channel" (CGC); which detects trainer gaze-behavior and displays the point of regard to the trainee. A randomized crossover study was conducted in which twenty subjects performed a simulated robotic surgical task necessitating collaboration either with verbal (control condition) or visual guidance with CGC (study condition).

The role of the posterior parietal cortex in stereopsis and hand-eye coordination during motor task behaviours.

The field of 'Neuroergonomics' has the potential to improve safety in high-risk operative environments through a better appreciation of the way in which the brain responds during human-tool interactions. This is especially relevant to minimally invasive surgery (MIS). Amongst the many challenges imposed on the surgeon by traditional MIS (laparoscopy), arguably the greatest is the loss of depth perception.

Enhanced frontoparietal network architectures following "gaze-contingent" versus "free-hand" motor learning.

Longitudinal changes in cortical function are known to accompany motor skills learning, and can be detected as an evolution in the activation map. These changes include attenuation in activation in the prefrontal cortex and increased activation in primary and secondary motor regions, the cerebellum and posterior parietal cortex. Despite this, comparatively little is known regarding the impact of the mode or type of training on the speed of activation map plasticity and on longitudinal variation in network architectures.

Collaborative gaze channelling for improved cooperation during robotic assisted surgery.

The use of multiple robots for performing complex tasks is becoming a common practice for many robot applications. When different operators are involved, effective cooperation with anticipated manoeuvres is important for seamless, synergistic control of all the end-effectors. In this paper, the concept of Collaborative Gaze Channelling (CGC) is presented for improved control of surgical robots for a shared task.