Static Hand Gesture Recognition Using Capacitive Sensing and Machine Learning.

Sensors (Basel)

Department of Mechanical and Electrical Engineering, School of Food and Advanced Technology, College of Sciences, Auckland Campus, Auckland 0632, New Zealand.

Published: March 2023

Automated hand gesture recognition is a key enabler of Human-to-Machine Interfaces (HMIs) and smart living. This paper reports the development and testing of a static hand gesture recognition system using capacitive sensing. Our system consists of a 6×18 array of capacitive sensors that captured five gestures-Palm, Fist, Middle, OK, and Index-of five participants to create a dataset of gesture images. The dataset was used to train Decision Tree, Naïve Bayes, Multi-Layer Perceptron (MLP) neural network, and Convolutional Neural Network (CNN) classifiers. Each classifier was trained five times; each time, the classifier was trained using four different participants' gestures and tested with one different participant's gestures. The MLP classifier performed the best, achieving an average accuracy of 96.87% and an average F1 score of 92.16%. This demonstrates that the proposed system can accurately recognize hand gestures and that capacitive sensing is a viable method for implementing a non-contact, static hand gesture recognition system.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10099234PMC
http://dx.doi.org/10.3390/s23073419DOI Listing

Publication Analysis

Top Keywords

hand gesture
16
gesture recognition
16
static hand
12
capacitive sensing
12
recognition system
8
neural network
8
classifier trained
8
gesture
5
recognition
4
capacitive
4

Similar Publications

Instruction-induced modulation of the visual stream during gesture observation.

Neuropsychologia

January 2025

Neuroscience Area, SISSA, Trieste, Italy; Dipartimento di Medicina dei Sistemi, Università di Roma-Tor Vergata, Roma, Italy.

Although gesture observation tasks are believed to invariably activate the action-observation network (AON), we investigated whether the activation of different cognitive mechanisms when processing identical stimuli with different explicit instructions modulates AON activations. Accordingly, 24 healthy right-handed individuals observed gestures and they processed both the actor's moved hand (hand laterality judgment task, HT) and the meaning of the actor's gesture (meaning task, MT). The main brain-level result was that the HT (vs MT) differentially activated the left and right precuneus, the left inferior parietal lobe, the left and right superior parietal lobe, the middle frontal gyri bilaterally and the left precentral gyrus.

View Article and Find Full Text PDF

Plug-and-play myoelectric control via a self-calibrating random forest common model.

J Neural Eng

January 2025

School of Informatics, The University of Edinburgh, 10 Chricton Street, Edinburgh, EH8 9LE, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND.

Objective: Electromyographic (EMG) signals show large variabilities over time due to factors such as electrode shifting, user behaviour variations, etc., substantially degrading the performance of myoelectric control models in long-term use. Previously one-time model calibration was usually required each time before usage.

View Article and Find Full Text PDF

Female athletes explicitly gesture in emotional situations.

Front Psychol

January 2025

Department of Motor Behavior in Sports, Institute of Health Promotion and Clinical Movement Science, German Sport University Cologne, Cologne, Germany.

Introduction: Both appraisal emotion approaches and self-regulation theory emphasize that appraising an event as conducive or detrimental to one's current goals may trigger an affective response that can be observed nonverbally. Because there may be a female advantage in the inhibition and self-regulation of emotions, we hypothesized that female but not male athletes regulate emotions during sports through explicit nonverbal behaviors.

Methods: All nonverbal hand movement behavior of right-handed female and male tennis athletes was recorded during competitive matches.

View Article and Find Full Text PDF

Myoelectric control has emerged as a promising approach for a wide range of applications, including controlling limb prosthetics, teleoperating robots and enabling immersive interactions in the Metaverse. However, the accuracy and robustness of myoelectric control systems are often affected by various factors, including muscle fatigue, perspiration, drifts in electrode positions and changes in arm position. The latter has received less attention despite its significant impact on signal quality and decoding accuracy.

View Article and Find Full Text PDF

Studies of the evolution of language rely heavily on comparisons to nonhuman primates, particularly the gestural communication of nonhuman apes. Differences between human and ape gestures are largely ones of degree rather than kind. For example, while human gestures are more flexible, ape gestures are not inflexible.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!