Bimanual Ultrasound Mid-Air Haptics for Virtual Reality Manipulation.

The ability to manipulate and physically feel virtual objects without any real object being present and without equipping the user has been a long-standing goal in virtual reality (VR). Emerging ultrasound mid-air haptics (UMH) technology could potentially address this challenge, as it enables remote tactile stimulation of unequipped users. However, to date, UMH has received limited attention in the field of haptic exploration and manipulation in virtual environments.

Visuo-Haptic Rendering of the Hand during 3D Manipulation in Augmented Reality.

Manipulating virtual objects with bare hands is a key interaction in Augmented Reality (AR) applications. However, there are still several limitations that affect the manipulation, including the lack of mutual visual occlusion between virtual and real content as well as the lack of haptic sensations. To address the two abovementioned matters, the role of the visuo-haptic rendering of the hand as sensory feedback is investigated.

Haptic Feedback, Performance and Arousal: A Comparison Study in an Immersive VR Motor Skill Training Task.

This article investigates the relationship between fine motor skill training in VR, haptic feedback, and physiological arousal. To do so, we present the design and development of a motor skill task (buzzwire), along with a custom vibrotactile feedback attachment for the Geomagic Touch haptic device. A controlled experiment following a between-subjects design was conducted with 73 participants, studying the role of three feedback conditions - visual/kinesthetic, visual/vibrotactile and visual only - on the learning and performance of the considered task and the arousal levels of the participants.

A Wearable Haptic Device for the Hand With Interchangeable End-Effectors.

This article presents a 4-degrees-of-freedom (4-DoF) hand wearable haptic device for Virtual Reality (VR). It is designed to support different end-effectors, that can be easily exchanged so as to provide a wide range of haptic sensations. The device is composed of a static upper body, secured to the back of the hand, and the (changeable) end-effector, placed in contact with the palm.

Investigating the Haptic Perception of Directional Information Within a Handle.

This paper studies the perception of 2-dimensional directional cues presented on a hand-held tangible interface that resembles a cylindrical handle. The tangible interface is designed to be comfortably held with one hand and houses five custom electromagnetic actuators composed of coils as stators and magnets as movers. We carried out a human subjects experiment enrolling 24 participants, analysing the recognition rate of directional cues using the actuators either to vibrate or tap in sequence across the user's palm.

Does Multi-Actuator Vibrotactile Feedback Within Tangible Objects Enrich VR Manipulation?

Rich, informative and realistic haptic feedback is key to enhancing Virtual Reality (VR) manipulation. Tangible objects provide convincing grasping and manipulation interactions with haptic feedback of e.g.

Deconstructing Haptic Feedback Information in Robot-Assisted Needle Insertion in Soft Tissues.

This paper evaluates the role and effectiveness of different types of haptic feedback in presenting relevant feedback information during needle insertion in soft tissues through a remotely operated robot. We carried out three experiments with human subjects to analyze the effect of grounded kinesthetic feedback, cutaneous vibrotactile feedback, and cutaneous pressure feedback for rendering the elastic and the viscous force components of a simplified needle-tissue interaction model in a simulated environment. Results showed that providing the two pieces of feedback information through different channels, i.

Ultrasound Mid-Air Haptics for Hand Guidance in Virtual Reality.

This paper presents and evaluates a set of mid-air ultrasound haptic strategies to provide 2-degree-of-freedom position and orientation guidance in Virtual Reality (VR). We devised four strategies for providing position guidance and two for providing orientation guidance. A human subject study evaluated the effectiveness of the proposed techniques in guiding users towards objectives in static and dynamic environments in VR, both in position and orientation.

Can we Effectively Combine Tangibles and Ultrasound Mid-Air Haptics? A Study of Acoustically Transparent Tangible Surfaces.

We propose to study the combination of acoustically transparent tangible objects (ATTs) and ultrasound mid-air haptic (UMH) feedback to support haptic interactions with digital content. Both these haptic feedback methods have the advantage of leaving users unencumbered, and present uniquely complementary strengths and weaknesses. In this article, we provide an overview of the design space for haptic interactions covered by this combination, as well as requirements for their technical implementation.

When Tangibles Become Deformable: Studying Pseudo-Stiffness Perceptual Thresholds in a VR Grasping Task.

Pseudo-Haptic techniques, or visuo-haptic illusions, leverage user's visual dominance over haptics to alter the users' perception. As they create a discrepancy between virtual and physical interactions, these illusions are limited to a perceptual threshold. Many haptic properties have been studied using pseudo-haptic techniques, such as weight, shape or size.

PalmEx: Adding Palmar Force-Feedback for 3D Manipulation With Haptic Exoskeleton Gloves.

Haptic exoskeleton gloves are a widespread solution for providing force-feedback in Virtual Reality (VR), especially for 3D object manipulations. However, they are still lacking an important feature regarding in-hand haptic sensations: the palmar contact. In this paper, we present PalmEx, a novel approach which incorporates palmar force-feedback into exoskeleton gloves to improve the overall grasping sensations and manual haptic interactions in VR.

Action-Specific Perception & Performance on a Fitts's Law Task in Virtual Reality: The Role of Haptic Feedback.

While user's perception and performance are predominantly examined independently in virtual reality, the Action-Specific Perception (ASP) theory postulates that the performance of an individual on a task modulates this individual's spatial and time perception pertinent to the task's components and procedures. This paper examines the association between performance and perception and the potential effects that tactile feedback modalities could generate. This paper reports a user study (N=24), in which participants performed a standardized Fitts's law target acquisition task by using three feedback modalities: visual, visuo-electrotactile, and visuo-vibrotactile.

Electrotactile Feedback Applications for Hand and Arm Interactions: A Systematic Review, Meta-Analysis, and Future Directions.

Haptic feedback is critical in a broad range of human-machine/computer-interaction applications. However, the high cost and low portability/wearability of haptic devices remain unresolved issues, severely limiting the adoption of this otherwise promising technology. Electrotactile interfaces have the advantage of being more portable and wearable due to their reduced actuators' size, as well as their lower power consumption and manufacturing cost.

Design of Personalized Wearable Haptic Interfaces to Account for Fingertip Size and shape.

The size and shape of fingertips vary significantly across humans, making it challenging to design wearable fingertip interfaces suitable for everyone. Although deemed important, this issue has often been neglected due to the difficulty of customizing devices for each different user. This article presents an innovative approach for automatically adapting the hardware design of a wearable haptic interface for a given user.

Capacitive Sensing for Improving Contact Rendering With Tangible Objects in VR.

We combine tracking information from a tangible object instrumented with capacitive sensors and an optical tracking system, to improve contact rendering when interacting with tangibles in VR. A human-subject study shows that combining capacitive sensing with optical tracking significantly improves the visuohaptic synchronization and immersion of the VR experience.

Crowd Navigation in VR: Exploring Haptic Rendering of Collisions.

Virtual reality (VR) is a valuable experimental tool for studying human movement, including the analysis of interactions during locomotion tasks for developing crowd simulation algorithms. However, these studies are generally limited to distant interactions in crowds, due to the difficulty of rendering realistic sensations of collisions in VR. In this article, we explore the use of wearable haptics to render contacts during virtual crowd navigation.

Caring About the Human Operator: Haptic Shared Control for Enhanced User Comfort in Robotic Telemanipulation.

Haptic shared control enables a human operator and an autonomous controller to share the control of a robotic system using haptic active constraints. It has been used in robotic teleoperation for different purposes, such as navigating along paths minimizing the torques requested to the manipulator or avoiding possibly dangerous areas of the workspace. However, few works have focused on using these ideas to account for the user's comfort.

Altering the Stiffness, Friction, and Shape Perception of Tangible Objects in Virtual Reality Using Wearable Haptics.

Tangible objects are used in virtual reality (VR) and augmented reality (AR) to enhance haptic information on the general shape of virtual objects. However, they are often passive or unable to simulate rich varying mechanical properties. This article studies the effect of combining simple passive tangible objects and wearable haptics for improving the display of varying stiffness, friction, and shape sensations in these environments.

Compensating for Fingertip Size to Render Tactile Cues More Accurately.

Fingertip haptic feedback offers advantages in many applications, including robotic teleoperation, gaming, and training. However, fingertip size and shape vary significantly across humans, making it difficult to design fingertip interfaces and rendering techniques suitable for everyone. This article starts with an existing data-driven haptic rendering algorithm that ignores fingertip size, and it then develops two software-based approaches to personalize this algorithm for fingertips of different sizes using either additional data or geometry.

Power Wheelchair Navigation Assistance Using Wearable Vibrotactile Haptics.

People with severe disabilities often rely on power wheelchairs for moving around. However, if their driving abilities are affected by their condition, driving a power wheelchair can become very dangerous, both for themselves and the surrounding environment. This article proposes the use of wearable vibrotactile haptics for wheelchair navigation assistance.

PUMAH: Pan-Tilt Ultrasound Mid-Air Haptics for Larger Interaction Workspace in Virtual Reality.

Mid-air haptic interfaces are promising tools for providing tactile feedback in Virtual Reality (VR) applications, as they do not require the user to be tethered to, hold, or wear any system or device. Currently, focused ultrasound phased arrays are the most mature solution for providing mid-air haptic feedback. They modulate the phase of an array of ultrasound emitters so as to generate focused points of oscillating high pressure, eliciting vibrotactile sensations when encountering a user's skin.

A Haptic Shared-Control Architecture for Guided Multi-Target Robotic Grasping.

Although robotic telemanipulation has always been a key technology for the nuclear industry, little advancement has been seen over the last decades. Despite complex remote handling requirements, simple mechanically linked master-slave manipulators still dominate the field. Nonetheless, there is a pressing need for more effective robotic solutions able to significantly speed up the decommissioning of legacy radioactive waste.

A robotic microsurgical forceps for transoral laser microsurgery.

Purpose: In transoral laser microsurgery (TLM), the close curved cylindrical structure of the laryngeal region offers functional challenges to surgeons who operate on its malignancies with rigid, single degree-of-freedom (DOF) forceps. These challenges include surgeon hand tremors, poor reachability, poor tissue surface perception, and reduced ergonomy in design. The integrated robotic microsurgical forceps presented here is capable of addressing the above challenges through tele-operated tissue manipulation in TLM.

Steering and control of miniaturized untethered soft magnetic grippers with haptic assistance.

Untethered miniature robotics have recently shown promising results in several scenarios at the microscale, such as targeted drug delivery, microassembly, and biopsy procedures. However, the vast majority of these small-scale robots have very limited manipulation capabilities, and none of the steering systems currently available enable humans to intuitively and effectively control dexterous miniaturized robots in a remote environment. In this paper, we present an innovative micro teleoperation system with haptic assistance for the intuitive steering and control of miniaturized self-folding soft magnetic grippers in 2-D space.