This paper presents the development of a visual-perception system on a dual-arm mobile robot for human-robot interaction. This visual system integrates three subsystems. Hand gesture recognition is utilized to trigger human-robot interaction. Engagement and intention of the participants are detected and quantified through a cognitive system. Visual servoing uses YOLO to identify the object to be tracked and hybrid, model-based tracking to follow the object's geometry. The proposed visual-perception system is implemented in the developed dual-arm mobile robot, and experiments are conducted to validate the proposed method's effects on human-robot interaction applications.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9739664 | PMC |
| http://dx.doi.org/10.3390/s22239545 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Speech-mediated manipulation of da Vinci surgical system for continuous surgical flow.
Biomed Eng Lett
January 2025
Department of Biomedical Engineering, Seoul National University College of Medicine, 103 Daehak-ro, Jongno- gu, Seoul, 03080 Republic of Korea.
Unlabelled: With the advent of robot-assisted surgery, user-friendly technologies have been applied to the da Vinci surgical system (dVSS), and their efficacy has been validated in worldwide surgical fields. However, further improvements are required to the traditional manipulation methods, which cannot control an endoscope and surgical instruments simultaneously. This study proposes a speech recognition control interface (SRCI) for controlling the endoscope via speech commands while manipulating surgical instruments to replace the traditional method.
View Article and Find Full Text PDFDevelopment of a Virtual Robot Rehabilitation Training System for Children with Cerebral Palsy: An Observational Study.
Sensors (Basel)
December 2024
Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia.
This paper presents the development of a robotic system for the rehabilitation and quality of life improvement of children with cerebral palsy (CP). The system consists of four modules and is based on a virtual humanoid robot that is meant to motivate and encourage children in their rehabilitation programs. The efficiency of the developed system was tested on two children with CP.
View Article and Find Full Text PDFChild-Centric Robot Dialogue Systems: Fine-Tuning Large Language Models for Better Utterance Understanding and Interaction.
Sensors (Basel)
December 2024
Department of Information Convergence Engineering, Pusan National University, Busan 46241, Republic of Korea.
Dialogue systems must understand children's utterance intentions by considering their unique linguistic characteristics, such as syntactic incompleteness, pronunciation inaccuracies, and creative expressions, to enable natural conversational engagement in child-robot interactions. Even state-of-the-art large language models (LLMs) for language understanding and contextual awareness cannot comprehend children's intent as accurately as humans because of their distinctive features. An LLM-based dialogue system should acquire the manner by which humans understand children's speech to enhance its intention reasoning performance in verbal interactions with children.
View Article and Find Full Text PDFA High-Repeatability Three-Dimensional Force Tactile Sensing System for Robotic Dexterous Grasping and Object Recognition.
Micromachines (Basel)
December 2024
School of Aerospace Science and Technology, Xidian University, Xi'an 710071, China.
Robotic devices with integrated tactile sensors can accurately perceive the contact force, pressure, sliding, and other tactile information, and they have been widely used in various fields, including human-robot interaction, dexterous manipulation, and object recognition. To address the challenges associated with the initial value drift, and to improve the durability and accuracy of the tactile detection for a robotic dexterous hand, in this study, a flexible tactile sensor is designed with high repeatability by introducing a supporting layer for pre-separation. The proposed tactile sensor has a detection range of 0-5 N with a resolution of 0.
View Article and Find Full Text PDFMulti-Exoskeleton Performance Evaluation: Integrated Muscle Energy Indices to Determine the Quality and Quantity of Assistance.
Bioengineering (Basel)
December 2024
Department of Advanced Robotics (ADVR), Istituto Italiano di Tecnologia (IIT), 16163 Genova, Italy.
The assessment of realistic work tasks is a critical aspect of introducing exoskeletons to work environments. However, as the experimental task's complexity increases, the analysis of muscle activity becomes increasingly challenging. Thus, it is essential to use metrics that adequately represent the physical human-exoskeleton interaction (pHEI).
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!