During the past 60 years scientific research proposed many techniques to control robotic hand prostheses with surface electromyography (sEMG). Few of them have been implemented in commercial systems also due to limited robustness that may be improved with multimodal data. This paper presents the first acquisition setup, acquisition protocol and dataset including sEMG, eye tracking and computer vision to study robotic hand control. A data analysis on healthy controls gives a first idea of the capabilities and constraints of the acquisition procedure that will be applied to amputees in a next step. Different data sources are not fused together in the analysis. Nevertheless, the results support the use of the proposed multimodal data acquisition approach for prosthesis control. The sEMG movement classification results confirm that it is possible to classify several grasps with sEMG alone. sEMG can detect the grasp type and also small differences in the grasped object (accuracy: 95%). The simultaneous recording of eye tracking and scene camera data shows that these sensors allow performing object detection for grasp selection and that several neurocognitive parameters need to be taken into account for this. In conclusion, this work on intact subjects presents an innovative acquisition setup and protocol. The first results in terms of data analysis are promising and set the basis for future work on amputees, aiming to improve the robustness of prostheses with multimodal data.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1109/ICORR.2017.8009404 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
PbS Quantum Dot-Based Optoelectronic Memristors toward Multi-Task Reservoir Computing.
J Phys Chem Lett
December 2024
Institute of Optoelectronic Technology, Fuzhou University, Fuzhou 350116, China.
The rise of big data and the internet of things has driven the demand for multimodal sensing and high-efficiency low-latency processing. Inspired by the human sensory system, we present a multifunctional optoelectronic-memristor-based reservoir computing (OM-RC) system by utilizing a CuSCN/PbS quantum dots (QDs) heterojunction. The OM-RC system exhibits volatile and nonlinear responses to electrical signals and wide-spectrum optical stimuli covering ultraviolet, visible, and near-infrared (NIR) regions, enabling multitask processing of dynamic signals.
View Article and Find Full Text PDFCoupling of state space modules and attention mechanisms: An input-aware multi-contrast MRI synthesis method.
Med Phys
December 2024
Jiangsu Key Laboratory for Biomaterials and Devices, School of Biological Science and Medical Engineering, Southeast University, Nanjing, China.
Background: Medical imaging plays a pivotal role in the real-time monitoring of patients during the diagnostic and therapeutic processes. However, in clinical scenarios, the acquisition of multi-modal imaging protocols is often impeded by a number of factors, including time and economic costs, the cooperation willingness of patients, imaging quality, and even safety concerns.
Purpose: We proposed a learning-based medical image synthesis method to simplify the acquisition of multi-contrast MRI.
Integrating rare pathogenic variant prioritization with gene-based association analysis to identify novel genes and relevant multimodal traits for Alzheimer's disease.
Alzheimers Dement
December 2024
Department of Neurology, Zhongshan Hospital and Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
Introduction: Increasing evidence has highlighted rare variants in Alzheimer's disease (AD). However, insufficient sample sizes, especially in underrepresented ethnic groups, hinder their investigation. Additionally, their impact on endophenotypes remains largely unexplored.
View Article and Find Full Text PDFPulling at All Threads: Reflections on Using Multimodal Critical Discourse Analysis Within Arts-Based Health Research.
Qual Health Res
December 2024
École de Santé Publique de l'Université de Montréal and Centre de Recherche en Santé Publique, Montreal, QC, Canada.
Multimodal critical discourse analysis is a dynamic approach to qualitative data analysis that expands critical discourse analysis to include multiple communicative modes-such as images, graphics, video, and sound/music-into the semiotic analysis of ideology and power relations within contemporary forms of communication. We reflect on the potential of multimodal critical discourse analysis to be combined with arts-based health research as an analytic method to deconstruct discourses that shape the health and well-being of marginalized communities. Specifically, we frame this potential within our research about men's body image based a project using cellphilming and the deconstruction of cis-heteronormative and related ideologies.
View Article and Find Full Text PDFRole of Community-Clinical Partnerships to Promote Cancer Screening: Lessons Learned From the National Breast and Cervical Cancer Early Detection Program.
Health Promot Pract
December 2024
Centers for Disease Control and Prevention, Chamblee, GA, USA.
Community-clinical partnerships are an effective approach to connecting primary care with public health to increase disease prevention and screenings and reduce health inequities. We explore how the National Breast and Cervical Cancer Early Detection Program (NBCCEDP) award recipients and clinic teams are using community-clinical linkages to deliver services to populations who are without access to health care and identify barriers, facilitators, and lessons that can be used to improve program implementation. We used purposive sampling to select nine state recipients of the NBCCEDP and a clinic partner for each recipient.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!