Multi3: Multi-sensory perception system for multi-modal child interaction with multiple robots
Ημερομηνία
2018Γλώσσα
en
Λέξη-κλειδί
Επιτομή
Child-robot interaction is an interdisciplinary research area that has been attracting growing interest, primarily focusing on edutainment applications. A crucial factor to the successful deployment and wide adoption of such applications remains the robust perception of the child's multimodal actions, when interacting with the robot in a natural and untethered fashion. Since robotic sensory and perception capabilities are platform-dependent and most often rather limited, we propose a multiple Kinect-based system to perceive the child-robot interaction scene that is robot-independent and suitable for indoors interaction scenarios. The audio-visual input from the Kinect sensors is fed into speech, gesture, and action recognition modules, appropriately developed in this paper to address the challenging nature of child-robot interaction. For this purpose, data from multiple children are collected and used for module training or adaptation. Further, information from the multiple sensors is fused to enhance module performance. The perception system is integrated in a modular multi-robot architecture demonstrating its flexibility and scalability with different robotic platforms. The whole system, called Multi3, is evaluated, both objectively at the module level and subjectively in its entirety, under appropriate child-robot interaction scenarios containing several carefully designed games between children and robots. © 2018 IEEE.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Control of medical robotics and neurorobotic prosthetics by non invasive brain-robot interfaces via EEG and RFID technology
Eleni, A. (2008)Brain-robot interface (BRI) has been a growing field of innovative research and development in cognitive neuroscience and brain bioimaging processing technologies. In this paper we endeavor to explore how medical robotics ... -
Beetle-robot hybrid interaction: sex, lateralization and mating experience modulate behavioural responses to robotic cues in the larger grain borer Prostephanus truncatus (Horn)
Romano D., Benelli G., Kavallieratos N.G., Athanassiou C.G., Canale A., Stefanini C. (2020)Ethorobotics, a new fascinating field of biorobotics, proposes the use of robotic replicas as an advanced method for investigating animal behaviour. This novel research approach can also encourage the development of advanced ... -
ChildBot: Multi-robot perception and interaction with children
Efthymiou N., Filntisis P.P., Koutras P., Tsiami A., Hadfield J., Potamianos G., Maragos P. (2022)In this paper, we present an integrated robotic system capable of participating in and performing a wide range of educational and entertainment tasks collaborating with one or more children. The system, called ChildBot, ...