A concept for emotion recognition systems for children with profound intellectual and multiple disabilities based on artificial intelligence using physiological and motion signals.

Purpose: This study proposes a concept for emotion recognition systems for children with profound intellectual and multiple disabilities (PIMD) based on artificial intelligence (AI) using physiological and motion signals.

Methods: First, the heartbeat interval (R-R interval, RRI) of a child with PIMD was measured, and the correlation between the RRI and emotion was briefly tested in a preliminary experiment. Then, a concept based on AI for emotion recognition systems for children with PIMD was created using physiological and motion signals, and an emotion recognition system based on the proposed concept was developed using a random forest classifier taking as inputs the RRI, eye gaze, and other data acquired using low physical burden sensors. Subsequently, the developed emotion recognition system was evaluated, validating the proposed concept. Finally, we proposed a validated concept for emotion recognition systems.

Results: A correlation was found between the RRI and emotion. The emotion recognition system was created based on the proposed concept and tested. According to the results, the recognition rate of "negative" and "not negative" of 70.4% ± 6.1% (Mean ± S.D.) of the developed emotion recognition system was higher than 48.5% ± 5.0% of an unfamiliar person used as a control.

Conclusion: The results indicate that the proposed concept for emotion recognition systems is useful for communicating with children with PIMD.