An Audiovisual Child Emotion Recognition System for Child-Robot Interaction Applications
Datum
2021Language
en
Schlagwort
Zusammenfassung
We present an audiovisual emotion recognition system tailored to child-robot interaction scenarios. Our proposed system is based on deep learning and the Temporal Segment Networks framework, receives input from both the child's speech and video modalities (the latter represented as RGB and optical flow streams), and tackles several challenges that arise in emotion recognition and child-robot interaction. The system is evaluated on the EmoReact child emotion recognition dataset, significantly outperforming the state-of-the-art on this corpus. In addition, extensive ablation studies are conducted. © 2021 European Signal Processing Conference. All rights reserved.
Collections
Verwandte Dokumente
Anzeige der Dokumente mit ähnlichem Titel, Autor, Urheber und Thema.
-
Resource-efficient TDNN Architectures for Audio-visual Speech Recognition
Koumparoulis A., Potamianos G., Thomas S., da Silva Morais E. (2021)In this paper, we consider the problem of resource-efficient architectures for audio-visual automatic speech recognition (AVSR). Specifically, we complement our earlier work that introduced efficient convolutional neural ... -
Low-Complexity Hand Gesture Recognition System for Continuous Streams of Digits and Letters
Poularakis S., Katsavounidis I. (2016)In this paper, we propose a complete gesture recognition framework based on maximum cosine similarity and fast nearest neighbor (NN) techniques, which offers high-recognition accuracy and great computational advantages for ... -
ChildBot: Multi-robot perception and interaction with children
Efthymiou N., Filntisis P.P., Koutras P., Tsiami A., Hadfield J., Potamianos G., Maragos P. (2022)In this paper, we present an integrated robotic system capable of participating in and performing a wide range of educational and entertainment tasks collaborating with one or more children. The system, called ChildBot, ...