This manuscript introduces a mobile cobot equipped with a custom-designed high payload arm called RELAX combined with a novel unified multimodal interface that facilitates Human-Robot Collaboration (HRC) tasks requiring high-level interaction forces on a real-world scale. The proposed multimodal framework is capable of combining physical interaction, Ultra Wide-Band (UWB) radio sensing, a Graphical User Interface (GUI), verbal control, and gesture interfaces, combining the benefits of all these different modalities and allowing humans to accurately and efficiently command the RELAX mobile cobot and collaborate with it. The effectiveness of the multimodal interface is evaluated in scenarios where the operator guides RELAX to reach designated locations in the environment while avoiding obstacles and performing high-payload transportation tasks, again in a collaborative fashion. The results demonstrate that a human co-worker can productively complete complex missions and command the RELAX mobile cobot using the proposed multimodal interaction framework.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10534361PMC
http://dx.doi.org/10.3390/s23187735DOI Listing

Publication Analysis

Top Keywords

multimodal interface
12
mobile cobot
12
unified multimodal
8
proposed multimodal
8
command relax
8
relax mobile
8
relax
5
interface
4
interface relax
4
relax high-payload
4

Similar Publications

Highly Elastic Spongelike Hydrogels for Impedance-Based Multimodal Sensing.

ACS Nano

January 2025

School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Republic of Singapore.

Hydrogel-based sensors have been widely studied for perceiving the environment. However, the simplest type of resistive sensors still lacks sensitivity to localized strain and other extractable data. Enhancing their sensitivity and expanding their functionality to perceive multiple stimuli simultaneously are highly beneficial yet require optimal material design and proper testing methods.

View Article and Find Full Text PDF

Flexible thermoelectric generators (FTEGs) can continuously harvest energy from the environment or the human body to supply wearable electronic devices, which should be a clean energy solution and provide an opportunity to satisfy the increasing power consumption of multimodal sensing and data transmission in wearable electronic devices. Here, the 64-pair FTEG was fabricated by introducing the plated through-hole and heterotypic electrode structures to optimize the thermal transport, showing the largely improved output power of 4.1 mW and record-high power density of 312 μW cm at a given ambient temperature of 15 °C inside a measurement equipment.

View Article and Find Full Text PDF

Tumor-microenvironment-mediated second near-infrared light activation multifunctional cascade nanoenzyme for self-replenishing O/HO multimodal tumor therapy.

J Colloid Interface Sci

December 2024

School of Physics and Electronic Sciences, Hunan Provincial Key Laboratory of Flexible Electronic Materials Genome Engineering, Changsha University of Science and Technology, Changsha 410114, PR China. Electronic address:

Developing a catalytic nanoenzyme activated by the tumor microenvironment (TME) shows excellent potential for in situ cancer treatment. However, the rational design of a cascade procedure to achieve high therapeutic efficiency remains challenging. In this study, the colorectal TME-responsive multifunctional cascade nanoenzyme CuO@MnO@glucose oxidase (GOx)@hyaluronic acid (HA) was developed to target in situ cancer starvation/chemodynamic therapy (CDT)/photothermal therapy (PTT).

View Article and Find Full Text PDF

Targeting the peculiarities of tumor tissue microenvironment different from normal tissue, such as lower pH and overexpression of hydrogen peroxide is the key to effective treatment. In this study, acid-responsive Z-scheme heterojunctions polyglycolated MoS/CoFeO (MoS = molybdenum disulfide, CoFeO = cobalt ferrite) was synthesized using a two-step hydrothermal method, designated as MSCO-PEG, guided by dual modes of photoacoustic imagine (PAI) and nuclear magnetic imaging (MRI). MSCO-PEG (PEG = polyethylene glycol) responded to the acidic environment of tumor tissues and overexpression of hydrogen peroxide to turn on multimodal synergistic treatment of tumor cells under near-infrared-II (NIR-II) illumination.

View Article and Find Full Text PDF

Implantable systems with chronic stability, high sensing performance, and extensive spatial-temporal resolution are a growing focus for monitoring and treating several diseases such as epilepsy, Parkinson's disease, chronic pain, and cardiac arrhythmias. These systems demand exceptional bendability, scalable size, durable electrode materials, and well-encapsulated metal interconnects. However, existing chronic implantable bioelectronic systems largely rely on materials prone to corrosion in biofluids, such as silicon nanomembranes or metals.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!