Real-time 3D human capture system for mixed-reality art and entertainment.

IEEE Trans Vis Comput Graph

Interactive and Entertainment Research Center, Level 02-02, Research Techno Plaza, Nanyang Technological University, 50 Nanyang Drive, Singapore 637553.

Published: December 2005

A real-time system for capturing humans in 3D and placing them into a mixed reality environment is presented in this paper. The subject is captured by nine cameras surrounding her. Looking through a head-mounted-display with a camera in front pointing at a marker, the user can see the 3D image of this subject overlaid onto a mixed reality scene. The 3D images of the subject viewed from this viewpoint are constructed using a robust and fast shape-from-silhouette algorithm. The paper also presents several techniques to produce good quality and speed up the whole system. The frame rate of our system is around 25 fps using only standard Intel processor-based personal computers. Besides a remote live 3D conferencing and collaborating system, we also describe an application of the system in art and entertainment, named Magic Land, which is a mixed reality environment where captured avatars of human and 3D computer generated virtual animations can form an interactive story and play with each other. This system demonstrates many technologies in human computer interaction: mixed reality, tangible interaction, and 3D communication. The result of the user study not only emphasizes the benefits, but also addresses some issues of these technologies.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TVCG.2005.105DOI Listing

Publication Analysis

Top Keywords

mixed reality
16
art entertainment
8
reality environment
8
human computer
8
system
7
real-time human
4
human capture
4
capture system
4
system mixed-reality
4
mixed-reality art
4

Similar Publications

: The aim is to bring attention to the existence of a rare type of trauma of the hand, high-pressure injection injury, that appears to be minor with negligible signs and symptoms within the first hours after the accident, but in reality, produces significant tissue destruction with severe consequences. Recognizing this type of trauma by medical personnel, understanding the mechanisms involved, and knowing the etiological and prognostic factors can lead to early treatment initiation and avoid severe mutilating sequelae. : A retrospective study on 16 patients diagnosed with high-pressure injection injuries, including water, air, paint, paint mixed paint with thinner, petroleum jelly, and lime (washable paint containing calcium oxide).

View Article and Find Full Text PDF

Residual Vision Transformer and Adaptive Fusion Autoencoders for Monocular Depth Estimation.

Sensors (Basel)

December 2024

Institute of Computer and Communication Engineering, Department of Electrical Engineering, National Cheng Kung University, Tainan 701, Taiwan.

Precision depth estimation plays a key role in many applications, including 3D scene reconstruction, virtual reality, autonomous driving and human-computer interaction. Through recent advancements in deep learning technologies, monocular depth estimation, with its simplicity, has surpassed the traditional stereo camera systems, bringing new possibilities in 3D sensing. In this paper, by using a single camera, we propose an end-to-end supervised monocular depth estimation autoencoder, which contains an encoder with a structure with a mixed convolution neural network and vision transformers and an effective adaptive fusion decoder to obtain high-precision depth maps.

View Article and Find Full Text PDF

Background: Virtual surgical planning for orthognathic surgery typically relies on two methods for intraoperative plan transfer: CAD/CAM occlusal splints and patient-specific implants (PSI). While CAD/CAM splints may offer limited accuracy, particularly in the vertical dimension, PSIs are constrained by higher costs and extended preparation times. Surgical navigation has emerged as a potential alternative, but existing protocols often involve invasive registration or lack transparent evaluation.

View Article and Find Full Text PDF

Background: Motor imagery is the mental representation of a movement without physical execution. When motor imagery is performed to enhance motor learning and performance, participants must reach a temporal congruence between the imagined and actual movement execution. Identifying factors that can influence this capacity could enhance the effectiveness of motor imagery programs.

View Article and Find Full Text PDF

Exploring New Tools in Upper Limb Rehabilitation After Stroke Using an Exoskeletal Aid: A Pilot Randomized Control Study.

Healthcare (Basel)

January 2025

Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, 45110 Ioannina, Greece.

Background/objectives: Spasticity commonly occurs in individuals after experiencing a stroke, impairing their hand function and limiting activities of daily living (ADLs). In this paper, we introduce an exoskeletal aid, combined with a set of augmented reality (AR) games consisting of the Rehabotics rehabilitation solution, designed for individuals with upper limb spasticity following stroke.

Methods: Our study, involving 60 post-stroke patients (mean ± SD age: 70.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!