Real-Time Learning and Recognition of Assembly Activities Based on Virtual Reality Demonstration.

Sensors (Basel)

State Key Laboratory of Virtual Reality Technology and Systems, School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China.

Published: September 2021

Teaching robots to learn through human demonstrations is a natural and direct method, and virtual reality technology is an effective way to achieve fast and realistic demonstrations. In this paper, we construct a virtual reality demonstration system that uses virtual reality equipment for assembly activities demonstration, and using the motion data of the virtual demonstration system, the human demonstration is deduced into an activity sequence that can be performed by the robot. Through experimentation, the virtual reality demonstration system in this paper can achieve a 95% correct rate of activity recognition. We also created a simulated ur5 robotic arm grasping system to reproduce the inferred activity sequence.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8472799PMC
http://dx.doi.org/10.3390/s21186201DOI Listing

Publication Analysis

Top Keywords

virtual reality
20
reality demonstration
12
demonstration system
12
assembly activities
8
activity sequence
8
virtual
6
demonstration
6
reality
5
real-time learning
4
learning recognition
4

Similar Publications

Gesture-controlled reconfigurable metasurface system based on surface electromyography for real-time electromagnetic wave manipulation.

Nanophotonics

January 2025

Key Laboratory for Information Science of Electromagnetic Waves, School of Information Science and Technology, Fudan University, Shanghai 200433, China.

Gesture recognition plays a significant role in human-machine interaction (HMI) system. This paper proposes a gesture-controlled reconfigurable metasurface system based on surface electromyography (sEMG) for real-time beam deflection and polarization conversion. By recognizing the sEMG signals of user gestures through a pre-trained convolutional neural network (CNN) model, the system dynamically modulates the metasurface, enabling precise control of the deflection direction and polarization state of electromagnetic waves.

View Article and Find Full Text PDF

This literature review explores the emerging role of digital twin (DT) technology in ophthalmology, emphasizing its potential to revolutionize personalized medicine. DTs integrate diverse data sources, including genetic, environmental, and real-time patient data, to create dynamic, predictive models that enhance risk assessment, surgical planning, and postoperative care. The review highlights vital case studies demonstrating the application of DTs in improving the early detection and management of diseases such as glaucoma and age-related macular degeneration.

View Article and Find Full Text PDF

The neurosociological paradigm of the metaverse.

Front Psychol

January 2025

Neurointerfaces and Neurotechnologies Laboratory, Neurosciences Research Institute, Samara State Medical University, Samara, Russia.

Metaverse integrates people into the virtual world, and challenges depend on advances in human, technological, and procedural dimensions. Until now, solutions to these challenges have not involved extensive neurosociological research. The study explores the pioneering neurosociological paradigm in metaverse, emphasizing its potential to revolutionize our understanding of social interactions through advanced methodologies such as hyperscanning and interbrain synchrony.

View Article and Find Full Text PDF

Introduction: Attention-deficit/hyperactivity disorder (ADHD) and autism are multi-faceted neurodevelopmental conditions with limited biological markers. The clinical diagnoses of autism and ADHD are based on behavioural assessments and may not predict long-term outcomes or response to interventions and supports. To address this gap, data-driven methods can be used to discover groups of individuals with shared biological patterns.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!