Immersive Robot Teleoperation Based on User Gestures in Mixed Reality Space.

Sensors (Basel)

Department of Mechatronics Engineering, Graduate School of Science and Technology, Meijo University, 501-1 Shiogamaguchi, Nagoya 468-8502, Japan.

Published: August 2024

Recently, research has been conducted on mixed reality (MR), which provides immersive visualization and interaction experiences, and on mapping human motions directly onto a robot in a mixed reality (MR) space to achieve a high level of immersion. However, even though the robot is mapped onto the MR space, their surrounding environment is often not mapped sufficiently; this makes it difficult to comfortably perform tasks that require precise manipulation of the objects that are difficult to see from the human perspective. Therefore, we propose a system that allows users to operate a robot in real space by mapping the task environment around the robot on the MR space and performing operations within the MR space.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11314798PMC
http://dx.doi.org/10.3390/s24155073DOI Listing

Publication Analysis

Top Keywords

mixed reality
12
reality space
8
space
6
immersive robot
4
robot teleoperation
4
teleoperation based
4
based user
4
user gestures
4
gestures mixed
4
space conducted
4

Similar Publications

This study evaluates the feasibility of Apple Vision Pro goggles as an augmented reality (AR) surgical navigation tool for laparoscopic-assisted ultrasound-guided radiofrequency ablation (RFA) of liver tumors. Traditional RFA is effective but challenging due to the integration of multiple imaging modalities. The primary aim of this research is to assess how Vision Pro goggles can enhance the surgical navigation process during RFA, improving tumor localization and the overall effectiveness of the procedure.

View Article and Find Full Text PDF

A Microfabrication Technique for High-Performance Diffractive Optical Elements Tailored for Numerical Simulation.

Nanomaterials (Basel)

January 2025

Key Laboratory of All Optical Network and Advanced Telecommunication Network, Ministry of Education, Institute of Lightwave Technology, Beijing Jiaotong University, Beijing 100044, China.

Diffractive optical elements (DOEs) are specialized optical components that manipulate light through diffraction for various applications, including holography, spectroscopy, augmented reality (AR) and virtual reality (VR), and light detection and ranging (LiDAR). The performance of DOEs is highly determined by fabricated materials and fabrication methods, in addition to the numerical simulation design. This paper presents a microfabrication technique optimized for DOEs, enabling precise control of critical parameters, such as refractive index (RI) and thickness.

View Article and Find Full Text PDF

Insights and trends review: Use of extended reality (xR) in hand surgery.

J Hand Surg Eur Vol

January 2025

Department of Human Enhancement and Hand Surgery, Nagoya University, Nagoya, Aichi, Japan.

Digital transformation through extended reality (xR)-comprising virtual, augmented, mixed, and substitutional reality-has become an integral part of the future of clinical and surgical practice. xR technologies facilitate advanced surgical planning, training, therapies and education, reshaping both personal and institutional healthcare. This paper examines the potential changes that xR has introduced into the field of hand surgery, exploring how xR enhances patient-centric care, increases medical service efficiency and revolutionizes surgical training, planning and therapeutic interventions.

View Article and Find Full Text PDF

Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities.

J Imaging

January 2025

Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL 60616, USA.

The integration of artificial intelligence into daily life significantly enhances the autonomy and quality of life of visually impaired individuals. This paper introduces the Visual Impairment Spatial Awareness (VISA) system, designed to holistically assist visually impaired users in indoor activities through a structured, multi-level approach. At the foundational level, the system employs augmented reality (AR) markers for indoor positioning, neural networks for advanced object detection and tracking, and depth information for precise object localization.

View Article and Find Full Text PDF

The Role of Artificial Intelligence and Emerging Technologies in Advancing Total Hip Arthroplasty.

J Pers Med

January 2025

Sezione di Chirurgia Protesica ad Indirizzo Robotico-Unità di Traumatologia dello Sport, Ortopedia e Traumatologia, Fondazione Poliambulanza, 25124 Brescia, Italy.

Total hip arthroplasty (THA) is a widely performed surgical procedure that has evolved significantly due to advancements in artificial intelligence (AI) and robotics. As demand for THA grows, reliable tools are essential to enhance diagnosis, preoperative planning, surgical precision, and postoperative rehabilitation. AI applications in orthopedic surgery offer innovative solutions, including automated hip osteoarthritis (OA) diagnosis, precise implant positioning, and personalized risk stratification, thereby improving patient outcomes.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!