Recent advancements in multimodal human-robot interaction.

Front Neurorobot

Department of GMSC, Pprime Institute, CNRS, ENSMA, University of Poitiers, Poitiers, France.

Published: May 2023

Robotics have advanced significantly over the years, and human-robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10210148PMC
http://dx.doi.org/10.3389/fnbot.2023.1084000DOI Listing

Publication Analysis

Top Keywords

human-robot interaction
8
multimodal hri
8
hri
6
advancements multimodal
4
multimodal human-robot
4
interaction robotics
4
robotics advanced
4
advanced years
4
years human-robot
4
interaction hri
4

Similar Publications

A Comprehensive Analysis of a Social Intelligence Dataset and Response Tendencies Between Large Language Models (LLMs) and Humans.

Sensors (Basel)

January 2025

Department of Electronics and Electrical Engineering, Faculty of Science and Technology, Keio University, 3-14-1, Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan.

In recent years, advancements in the interaction and collaboration between humans and have garnered significant attention. Social intelligence plays a crucial role in facilitating natural interactions and seamless communication between humans and Artificial Intelligence (AI). To assess AI's ability to understand human interactions and the components necessary for such comprehension, datasets like Social-IQ have been developed.

View Article and Find Full Text PDF

Multi-Modal Social Robot Behavioural Alignment and Learning Outcomes in Mediated Child-Robot Interactions.

Biomimetics (Basel)

January 2025

School of Engineering and Physical Sciences, Lincoln Centre for Autonomous Systems, College of Health and Science, University of Lincoln, Lincoln LN6 7TS, UK.

With the increasing application of robots in human-centred environments, there is increasing motivation for incorporating some degree of human-like social competences. Fields such as psychology and cognitive science not only provide guidance on the types of behaviour that could and should be exhibited by the robots, they may also indicate the manner in which these behaviours can be achieved. The domain of social child-robot interaction (sCRI) provides a number of challenges and opportunities in this regard; the application to an educational context allows child-learning outcomes to be characterised as a result of robot social behaviours.

View Article and Find Full Text PDF

Introduction: This study focused on the psychological evaluation of an avatar robot in two distinct regions, Dubai in the Middle East and Japan in the Far East. Dubai has experienced remarkable development in advanced technology, while Japan boasts a culture that embraces robotics. These regions are distinctively characterized by their respective relationships with robotics.

View Article and Find Full Text PDF

Soft robots and bioinspired systems have revolutionized robot design by incorporating flexibility and deformable materials inspired by nature's ingenious designs. Similar to many robotic applications, sensing and perception are paramount to enable soft robots to adeptly navigate the unpredictable real world, ensuring safe interactions with both humans and the environment. Despite recent progress, soft robot sensorization still faces significant challenges due to the virtual infinite degrees of freedom of the system and the need for efficient computational models capable of estimating valuable information from sensor data.

View Article and Find Full Text PDF

Endovascular interventions excel in treating cardiovascular diseases in a minimally invasive manner, showing improved outcomes over open techniques. However, challenges related to precise navigation - still relying on 2D fluoroscopy - persist. This review examines the role of robotics, highlighting commercial and research platforms, while exploring emerging trends like MRI compatibility, enhanced navigation, and autonomy.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!