Object Assembly Guidance in Child-Robot Interaction using RGB-D based 3D Tracking
Date
2018Language
en
Keyword
Abstract
This work examines how and to what benefit an autonomous humanoid robot can supervise a child in an object assembly task. In order to understand the child's actions, a novel 3D object tracking algorithm for RGB-D data is employed. The tracker consists of two stages: the first performs a tracking-by-detection scheme on the color stream, to locate the objects on the image plane, while the second uses a particle filter that operates on the depth data stream to refine the first stage output and infer the objects' rotations. Given the six degrees-of-freedom of the assembly part poses, the system is able to recognize which connections have been completed at any given time. This information is then used to select an appropriate verbal or gestural response for the robot. Experimental results show that (a) the tracking algorithm is accurate, fast and robust to severe occlusions and fast movements, (b) the proposed method of assembly state estimation is indeed effective, and (c) the resulting Child-Robot Interaction scenario is educational and enjoyable for the children involved. © 2018 IEEE.
Collections
Related items
Showing items related by title, author, creator and subject.
-
ChildBot: Multi-robot perception and interaction with children
Efthymiou N., Filntisis P.P., Koutras P., Tsiami A., Hadfield J., Potamianos G., Maragos P. (2022)In this paper, we present an integrated robotic system capable of participating in and performing a wide range of educational and entertainment tasks collaborating with one or more children. The system, called ChildBot, ... -
A variable impedance control strategy for object manipulation considering non-rigid grasp
Logothetis M., Karras G.C., Alevizos K., Kyriakopoulos K.J. (2020)This paper presents a novel control strategy for the compensation of the slippage effect during non-rigidly grasped object manipulation. A detailed dynamic model of the interconnected system composed of the robotic ... -
A Visual Servoing Strategy for Coastline Tracking using an Unmanned Aerial Vehicle
Aspragkathos S.N., Karras G.C., Kyriakopoulos K.J. (2022)In this paper, an Image-based Visual Servo (IBVS) Control strategy for the autonomous surveillance of coastlines using an octocopter aerial vehicle is proposed. The implemented strategy is focused on the vision-based ...