Objective: Ultrasound (US) probes scan over the surface of the human body to acquire US images in clinical vascular US diagnosis. However, due to the deformation and specificity of different human surfaces, the relationship between the scan trajectory of the skin and the internal tissues is not fully correlated, which poses a challenge for autonomous robotic US imaging in a dynamic and external-vision-free environment. Here, we propose a decoupled control strategy for autonomous robotic vascular US imaging in an environment without external vision.

Methods: The proposed system is divided into outer-loop posture control and inner-loop orientation control, which are separately determined by a deep learning (DL) agent and a reinforcement learning (RL) agent. First, we use a weakly supervised US vessel segmentation network to estimate the probe orientation. In the outer loop control, we use a force-guided reinforcement learning agent to maintain a specific angle between the US probe and the skin in the dynamic imaging processes. Finally, the orientation and the posture are integrated to complete the imaging process.

Results: Evaluation experiments on several volunteers showed that our RUS could autonomously perform vascular imaging in arms with different stiffness, curvature, and size without additional system adjustments. Furthermore, our system achieved reproducible imaging and reconstruction of dynamic targets without relying on vision-based surface information.

Conclusion And Significance: Our system and control strategy provides a novel framework for the application of US robots in complex and external-vision-free environments.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TBME.2023.3279114DOI Listing

Publication Analysis

Top Keywords

autonomous robotic
12
vascular imaging
12
control strategy
12
learning agent
12
decoupled control
8
external-vision-free environments
8
reinforcement learning
8
imaging
7
control
6
system
5

Similar Publications

With the escalating demand for exploration within confined spaces, bionic design methodologies have attracted considerable attention from researchers, primarily due to the intrinsic limitations of human access to hazardous environments. However, contemporary bionic robots primarily attain linear motion through the axial radial deformation of their body segments, thereby lacking the upright functionality that is characteristic of these organisms. In response to the limitations associated with current bionic earthworm robots concerning upright capability and stiffness modulation, we propose an innovative bionic robot that incorporates upright functionality and programmable stiffness.

View Article and Find Full Text PDF

Self-rerouting sensor network for electronic skin resilient to severe damage.

Nat Commun

January 2025

Toyota Central R&D Labs. Inc.; 41-1, Yokomichi, Nagakute, Aichi, Japan.

We propose a network architecture for electronic skin with an extensive sensor array-crucial for enabling robots to perceive their environment and interact effectively with humans. Fault tolerance is essential for electronic skins on robot exteriors. Although self-healing electronic skins targeting minor damages are studied using material-based approaches, substantial damages such as severe cuts necessitate re-establishing communication pathways, traditionally performed with high-functionality microprocessor sensor nodes.

View Article and Find Full Text PDF

Biological vision systems simultaneously learn to efficiently encode their visual inputs and to control the movements of their eyes based on the visual input they sample. This autonomous joint learning of visual representations and actions has previously been modeled in the Active Efficient Coding (AEC) framework and implemented using traditional frame-based cameras. However, modern event-based cameras are inspired by the retina and offer advantages in terms of acquisition rate, dynamic range, and power consumption.

View Article and Find Full Text PDF

A reward shaping deep deterministic policy gradient (RS-DDPG) and simultaneous localization and mapping (SLAM) path tracking algorithm is proposed to address the issues of low accuracy and poor robustness of target path tracking for robotic control during maneuver. RS-DDPG algorithm is based on deep reinforcement learning (DRL) and designs a reward function to optimize the parameters of DDPG to achieve the required tracking accuracy and stability. A visual SLAM algorithm based on semantic segmentation and geometric information is proposed to address the issues of poor robustness and susceptibility to interference from dynamic objects in dynamic scenes for SLAM based on visual sensors.

View Article and Find Full Text PDF

The road forward with swarm systems.

Philos Trans A Math Phys Eng Sci

January 2025

Faculty of Computer Science, Otto von Guericke University Magdeburg, Universitätsplatz, Magdeburg 39106, Germany.

Advances in artificial intelligence (AI) and robotics are accelerating progress in swarm systems. Large and bulky autonomous systems are being replaced with many, smaller, cheaper, distributed, decentralized and collectively smarter systems. However, developing these swarm intelligence systems comes with multiple challenges, including technological challenges to engineer smaller and smarter machines, interaction challenges to design novel interfaces and modalities for communication and sociotechnical challenges related to trustworthiness, ethics and legalities.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!