Publications by authors named "Dmitry Ryumin"
Heart rate is an essential vital sign to evaluate human health. Remote heart monitoring using cheaply available devices has become a necessity in the twenty-first century to prevent any unfortunate situation caused by the hectic pace of life. In this paper, we propose a new method based on the transformer architecture with a multi-skip connection biLSTM decoder to estimate heart rate remotely from videos.
View Article and Find Full Text PDFAudio-Visual Speech and Gesture Recognition by Sensors of Mobile Devices.
Sensors (Basel)
February 2023
Article Synopsis
- Audio-visual speech recognition (AVSR) improves speech recognition accuracy by incorporating visual information, especially in noisy environments, while hand gestures enhance human-computer interactions.
- The study introduces two deep neural network models for AVSR and gesture recognition, focusing on advanced fine-tuning strategies and three methods for merging audio and visual data.
- Testing on the LRW and AUTSL datasets yielded outstanding results, achieving 98.76% accuracy for AVSR and 98.56% for gesture recognition, showcasing the effectiveness of the proposed methods for mobile device applications.