Estimating SpO with Deep Oxygen Desaturations from Facial Video Under Various Lighting Conditions: A Feasibility Study.

This paper presents a feasibility study to collect data, process signals, and validate accuracy of peripheral oxygen saturation (SpO) estimation from facial video in various lighting conditions. We collected facial videos using RGB camera, without auto-tuning, from subjects when they were breathing through a mouth tube with their nose clipped. The videos were record under four lighting conditions: warm color temperature and normal brightness, neutral color temperature and normal brightness, cool color temperature and normal brightness, neutral color temperature and dim brightness.

RRDetection: Respiration Rate Estimation Using Earbuds During Physical Activities.

In modern times, earbuds have become both popular and essential accessories for people to use with a wide range of devices in their everyday lives. Moreover, the respiration rate is a crucial vital sign that is sensitive to various pathological conditions. Many earbuds now come equipped with multiple sensing capabilities, including inertial and acoustic sensors.

Power Optimized Smartwatch-Earbuds Multimodal System for Monitoring Activities of Daily Living.

Activities of daily living is an important entity to monitor for promoting healthy lifestyle for chronic disease patients, children and the healthy population. This paper presents a smartwatch and earbuds inertial sensors based multi-modal power efficient end-to-end mobile system for continuous, passive and accurate detection of broad daily activity classes. We collected various posture, stationary and moving activity data from 40 diverse subjects using earbuds and smartwatch and develop the novel power optimized end-to-end operational system consisting of i) optimized device sampling rates and Bluetooth packet transfer rates, ii) data buffering mechanism, iii) background services, and iv) optimized model size, and demonstrating 93% macro recall score in detecting various activities.

MM-HAR: Multi-Modal Human Activity Recognition Using Consumer Smartwatch and Earbuds.

Human Activity Recognition (HAR) is one of the important applications of digital health that helps to track fitness or to avoid sedentary behavior by monitoring daily activities. Due to the growing popularity of consumer wearable devices, smartwatches, and earbuds are being widely adopted for HAR applications. However, using just one of the devices may not be sufficient to track all activities properly.

Contactless Monitoring of Respiratory Rate and Breathing Absence from Head Movements Using an RGB Camera.

Contactless vital sign monitoring is more demanding for long-term, continuous, and unobtrusive measurements. Camera-based respiratory monitoring is receiving growing interest with advanced video technologies and computational power. The volume variations of the lungs for airflow changes create a periodic movement of the torso, but identifying the torso is more challenging than face detection in a video.

Enhanced Contactless Heart Rate Monitoring Using Camera with Motion Artifact Removal During Physical Activities.

Contactless monitoring of heart rate (HR) can improve passive and continuous tracking of cardiovascular activities and overall people's health. Remote photoplethysmography (rPPG) using a camera eliminates the need for a wearable device. rPPG-based HR has shown promising results to be accurate and comparable to conventional methods such as contact PPG.

Motion- Based Respiratory Rate Estimation with Motion Artifact Removal Using Video of Face and Upper Body.

Respiratory rate (RR) is a significant indicator of health conditions. Remote contactless measurement of RR is gaining popularity with recent respiratory tract infection awareness. Among various methods of contactless RR measurement, a video of an individual can be used to obtain an instantaneous RR.

Remote Photoplethysmography and Heart Rate Estimation by Dynamic Region of Interest Tracking.

Remote photoplethysmography (PPG) estimates vital signs by measuring changes in the reflected light from the human skin. Compared to traditional PPG techniques, remote PPG enables contactless measurement at a reduced cost. In this paper, we propose a novel method to extract remote PPG signals and heart rate from videos.

Detecting Physiological Responses Using Multimodal Earbud Sensors.

Continuous stress exposure negatively impacts mental and physical well-being. Physiological arousal due to stress affects heartbeat frequency, changes breathing pattern and peripheral temperature, among several other bodily responses. Traditionally stress detection is performed by collecting signals such as electrocardiogram (ECG), respiration, and skin conductance response using uncomfortable sensors such as a chestband.

Deep Multivariate Domain Translation for Device Invariant Pulmonary Patient Identification from Cough and Speech Sounds.

Pulmonary audio sensing from cough and speech sounds in commodity mobile and wearable devices is increasingly used for remote pulmonary patient monitoring, home healthcare, and automated disease analysis. Patient identification is important for such applications to ensure system accuracy and integrity, and thus avoiding errors and misdiagnosis. Widespread usage and deployment of such patient identification models across various devices are challenging due to domain shift of acoustic features because of device heterogeneity.

Utilizing Deep Learning on Limited Mobile Speech Recordings for Detection of Obstructive Pulmonary Disease.

Passive assessment of obstructive pulmonary disease has gained substantial interest over the past few years in the mobile and wearable computing communities. One of the promising approaches is speech-based pulmonary assessment wherein spontaneous or scripted speech is used to evaluate an individual's pulmonary condition. Recent approaches in this regard heavily rely on accurate speech activity segmentation and specific, hand-crafted features.

A Novel Multi-Centroid Template Matching Algorithm and Its Application to Cough Detection.

Cough is a major symptom of respiratory-related diseases. There exists a tremendous amount of work in detecting coughs from audio but there has been no effort to identify coughs from solely inertial measurement unit (IMU). Coughing causes motion across the whole body and especially on the neck and head.

SpeechSpiro: Lung Function Assessment from Speech Pattern as an Alternative to Spirometry for Mobile Health Tracking.

Respiratory illnesses are common in the United States and globally; people deal with these illnesses in various forms, such as asthma, chronic obstructive pulmonary diseases, or infectious respiratory diseases (e.g., coronavirus).

Real-Time Limb Motion Tracking with a Single IMU Sensor for Physical Therapy Exercises.

Limb exercises are common in physical therapy to improve range of motion (RoM), strength, and flexibility of the arm/leg. To improve therapy outcomes and reduce cost, motion tracking systems have been used to monitor the user's movements when performing the exercises and provide guidance. Traditional motion tracking systems are based on either cameras or inertial measurement unit (IMU) sensors.

Device Invariant Deep Neural Networks for Pulmonary Audio Event Detection Across Mobile and Wearable Devices.

Mobile and wearable devices are being increasingly used for developing audio based machine learning models to infer pulmonary health, exacerbation and activity. A major challenge to widespread usage and deployment of such pulmonary health monitoring audio models is to maintain accuracy and robustness across a variety of commodity devices, due to the effect of device heterogeneity. Because of this phenomenon, pulmonary audio models developed with data from one type of device perform poorly when deployed on another type of device.

RRMonitor: A Resource-Aware End-to-End System for Continuous Monitoring of Respiration Rate Using Earbuds.

Respiration rate is considered as a critical vital sign, and daily monitoring of respiration rate could provide helpful information about any acute condition in the human body. While researchers have been exploring mobile devices for respiration rate monitoring, passive and continuous monitoring is still not feasible due to many usability challenges (e.g.

Atrial Fibrillation Detection and Atrial Fibrillation Burden Estimation via Wearables.

Atrial Fibrillation (AF) is an important cardiac rhythm disorder, which if left untreated can lead to serious complications such as a stroke. AF can remain asymptomatic, and it can progressively worsen over time; it is thus a disorder that would benefit from detection and continuous monitoring with a wearable sensor. We develop an AF detection algorithm, deploy it on a smartwatch, and prospectively and comprehensively validate its performance on a real-world population that included patients diagnosed with AF.

Validation of an algorithm for continuous monitoring of atrial fibrillation using a consumer smartwatch.

Background: Consumer devices with broad reach may be useful in screening for atrial fibrillation (AF) in appropriate populations. However, currently no consumer devices are capable of continuous monitoring for AF.

Objective: The purpose of this study was to estimate the sensitivity and specificity of a smartwatch algorithm for continuous detection of AF from sinus rhythm in a free-living setting.

Toward Early Severity Assessment of Obstructive Lung Disease Using Multi-Modal Wearable Sensor Data Fusion During Walking.

Early detection of chronic diseases helps to minimize the disease impact on patient's health and reduce the economic burden. Continuous monitoring of such diseases helps in the evaluation of rehabilitation program effectiveness as well as in the detection of exacerbation. The use of everyday wearables i.

Adapting to Noise in Speech Obfuscation by Audio Profiling Using Generative Models for Passive Health Monitoring.

Passive health monitoring has been introduced as a solution for continuous diagnosis and tracking of subjects' condition with minimal effort. This is partially achieved by the technology of passive audio recording although it poses major audio privacy issues for subjects. Existing methods are limited to controlled recording environments and their prediction is significantly influenced by background noises.

CoughMatch - Subject Verification Using Cough for Personal Passive Health Monitoring.

Automatic cough detection using audio has advanced passive health monitoring on devices such as smart phones and wearables; it enables capturing longitudinal health data by eliminating user interaction and effort. One major issue arises when coughs from surrounding people are also detected; capturing false coughs leads to significant false alarms, excessive cough frequency, and thereby misdiagnosis of user condition. To address this limitation, in this paper, a method is proposed that creates a personal cough model of the primary subject using limited number of cough samples; the model is used by the automatic cough detection to verify whether the identified coughs match the personal pattern and belong to the primary subject.

CoughGAN: Generating Synthetic Coughs that Improve Respiratory Disease Classification.

Despite the prevalence of respiratory diseases, their diagnosis by clinicians is challenging. Accurately assessing airway sounds requires extensive clinical training and equipment that may not be easily available. Current methods that automate this diagnosis are hindered by their use of features that require pulmonary function tests.

Estimation of the Lung Function Using Acoustic Features of the Voluntary Cough.

Spirometry test, a measure of the patient's lung function, is the gold standard for diagnosis and monitoring of chronic pulmonary diseases. Spirometry is currently being done in hospital settings by having the patients blow the air out of their lungs forcefully and into the spirometer's tubes under the supervision and constant guidance of clinicians. This test is expensive, cumbersome and not easily applicable to every-day monitoring of these patients.

A Comprehensive Approach for Classification of the Cough Type.

Identifying the presence of sputum in the lung is essential in detection of diseases such as lung infection, pneumonia and cancer. Cough type classification (dry/wet) is an effective way of examining presence of lung sputum. This is traditionally done through physical exam in a clinical visit which is subjective and inaccurate.