An Audiovisual Child Emotion Recognition System for Child-Robot Interaction Applications
Date
2021Language
en
Keyword
Abstract
We present an audiovisual emotion recognition system tailored to child-robot interaction scenarios. Our proposed system is based on deep learning and the Temporal Segment Networks framework, receives input from both the child's speech and video modalities (the latter represented as RGB and optical flow streams), and tackles several challenges that arise in emotion recognition and child-robot interaction. The system is evaluated on the EmoReact child emotion recognition dataset, significantly outperforming the state-of-the-art on this corpus. In addition, extensive ablation studies are conducted. © 2021 European Signal Processing Conference. All rights reserved.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Resource-efficient TDNN Architectures for Audio-visual Speech Recognition
(2021)In this paper, we consider the problem of resource-efficient architectures for audio-visual automatic speech recognition (AVSR). Specifically, we complement our earlier work that introduced efficient convolutional neural ... -
Low-Complexity Hand Gesture Recognition System for Continuous Streams of Digits and Letters
(2016)In this paper, we propose a complete gesture recognition framework based on maximum cosine similarity and fast nearest neighbor (NN) techniques, which offers high-recognition accuracy and great computational advantages for ... -
ChildBot: Multi-robot perception and interaction with children
(2022)In this paper, we present an integrated robotic system capable of participating in and performing a wide range of educational and entertainment tasks collaborating with one or more children. The system, called ChildBot, ...