Purpose: In cardiac electrophysiology, a long and flexible catheter is delivered to a cardiac chamber for the treatment of arrhythmias. Although several robot-assisted platforms have been commercialized, the disorientation in tele-operation is still not well solved. We propose a validation platform for robot-assisted cardiac EP catheterization, integrating a customized MR Safe robot, a standard clinically used EP catheter, and a human-robot interface. Both model-based and model-free control methods are implemented in the platform for quantitative evaluation and comparison.

Methods: The model-based and model-free control methods were validated by subject test (ten participants), in which the subjects have to perform a simulated radiofrequency ablation task using both methods. A virtual endoscopic view of the catheter is also provided to enhance hand-to-eye coordination. Assessment indices for targeting accuracy and efficiency were acquired for the evaluation.

Results: (1) Accuracy: The average distance measured from catheter tip to the closest lesion target during ablation of model-free method was 19.1% shorter than that of model-based control. (2) Efficiency: The model-free control reduced the total missed targets by 35.8% and the maximum continuously missed targets by 46.2%, both indices corresponded to a low p value ([Formula: see text]).

Conclusion: The model-free method performed better in terms of both accuracy and efficiency, indicating the model-free control could adapt to soft interaction with environment, as compared with the model-based control that does not consider contacts.

Download full-text PDF

Source
http://dx.doi.org/10.1007/s11548-018-1757-zDOI Listing

Publication Analysis

Top Keywords

model-free control
20
model-based model-free
8
control methods
8
accuracy efficiency
8
model-free method
8
model-based control
8
missed targets
8
model-free
7
control
7
model-based
5

Similar Publications

This paper explores the applicability of bicycle-inspired balance control in a quadruped robot model. Bicycles maintain stability and change direction by intuitively steering the handle, which induces yaw motion in the body frame and generates an inertial effect to support balance. Inspired by this balancing strategy, we implemented a similar mechanism in a quadruped robot model, introducing a yaw trunk joint analogous to a bicycle's steering handle.

View Article and Find Full Text PDF

Taming chimeras in coupled oscillators using soft actor-critic based reinforcement learning.

Chaos

January 2025

Complex Systems Group, Department of Mathematics and Statistics, The University of Western Australia, Crawley, Western Australia 6009, Australia.

We propose a universal method based on deep reinforcement learning (specifically, soft actor-critic) to control the chimera state in the coupled oscillators. The policy for control is learned by maximizing the expectation of the cumulative reward in the reinforcement learning framework. With the aid of the local order parameter, we design a class of reward functions for controlling the chimera state, specifically confining the spatial position of coherent and incoherent domains to any desired lateral position of oscillators.

View Article and Find Full Text PDF
Article Synopsis
  • Reinforcement learning contrasts model-free (habitual) and model-based (goal-directed) decision-making, with the latter being more common in high-reward scenarios.
  • A study involving 81 participants revealed that frequent alcohol users lacked the ability to adjust their decision-making strategies based on reward levels, unlike non-users who displayed better model-based control in high-reward settings.
  • Both groups were less risk-averse in high stakes, but alcohol users were generally more prone to risky decisions and showed impaired flexibility in adapting to changing reward conditions.
View Article and Find Full Text PDF

The current research introduces a model-free ultra-local model (MFULM) controller that utilizes the multi-agent on-policy reinforcement learning (MAOPRL) technique for remotely regulating blood pressure through precise drug dosing in a closed-loop system. Within the closed-loop system, there exists a MFULM controller, an observer, and an intelligent MAOPRL algorithm. Initially, a flexible MFULM controller is created to make adjustments to blood pressure and medication dosages.

View Article and Find Full Text PDF

The study presents an intelligent, model-free current control strategy that eliminates the need for explicit plant models while efficiently reducing the effect of plant parameter perturbation. By employing a data-driven approach with fewer input features, the proposed scheme reduces the computational burden during training while maintaining high control performance. Unlike conventional model predictive current control (MPCC), which is computationally expensive because of solving optimization problems at each sample time, and requires precise plant models, the proposed method enhances system performance by addressing plant model discrepancies through data-driven techniques.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!