A Flexible Iontronic Capacitive Sensing Array for Hand Gesture Recognition Using Deep Convolutional Neural Networks.

Soft Robot

Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, Beijing, China.

Published: June 2023

Hand gesture recognition, one of the most popular research topics in human-machine interaction, is extensively used in visual and augmented reality, sign language translation, prosthesis control, and so on. To improve the flexibility and interactivity of wearable gesture sensing interfaces, flexible electronic systems for gesture recognition have been widely studied. However, these systems are limited in terms of wearability, stability, scalability, and robustness. Herein, we report a flexible wearable hand gesture recognition system that is based on an iontronic capacitive pressure sensing array and deep convolutional neural networks. The entire capacitive array is integrated into a flexible silicone wristband and can be comfortably and conveniently wrapped around the wrist. The pressure sensing array, which is composed of an iontronic film sandwiched between two flexible screen-printed electrode arrays, exhibits a high sensitivity (775.8 kPa), fast response time (65 ms), and high durability (over 6000 cycles). Image processing techniques and deep convolutional neural networks are applied for sensor signal feature extraction and hand gesture recognition. Several contexts such as intertrial test (average accuracy of 99.9%), intersession rewearing (average accuracy of 93.2%), electrode shift (average accuracy of 83.2%), and different arm positions during measurement (average accuracy of 93.1%) are evaluated.

Download full-text PDF

Source
http://dx.doi.org/10.1089/soro.2021.0209DOI Listing

Publication Analysis

Top Keywords

gesture recognition
20
hand gesture
16
average accuracy
16
sensing array
12
deep convolutional
12
convolutional neural
12
neural networks
12
iontronic capacitive
8
pressure sensing
8
gesture
6

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!