Replication of Infant Behaviours with a Babybot: Early Pointing Gesture Comprehension

Natural deictic communication with humanoid robots requires a mechanism for understanding pointing gestures. This mechanism should have a representation for space and time dynamics to accurately model joint covert attention. Here, we introduce a babybot that actualise a hybrid computational architecture for spatial covert attention which is embodied in the iCub humanoid robot. This developmental robotics architecture was an extension of our previous model that combines a connectionist model of pointing comprehension and a dynamic neural field model of infant saccade generation. In order to test the babybot's abilities, an attentional cueing design was built as it is a common methodology to study pointing gesture comprehension in the current developmental psychology literature. The babybot was evaluated by modelling two different age groups (i.e. 5- and 7-month-old infants) in two different attentional cueing experiments from Rohlfing et al.'s study where they have shown that a dynamic pointing covertly orients attention in early infancy as opposed to static pointing. These experiments were replicated by our babybot for all modelled age groups. The resemblance between infant and babybot behaviours supported the idea that motion information is important to disengage from the centrally salient stimulus to orient the attention to the distal ones. The current experimental setup and the model's ability to simulate different age groups provide a new platform to replicate other developmental studies on pointing comprehension to spotlight the reasons of the discrepancies between them.

[1]  Yukie Nagai,et al.  Learning to comprehend deictic gestures in robots and human infants , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[2]  M. Tomasello,et al.  A new look at infant pointing. , 2007, Child development.

[3]  E. Thelen,et al.  Connectionism and dynamic systems: are they really different? , 2003 .

[4]  Sebastian Schneegans,et al.  The Infant Orienting With Attention task: Assessing the neural basis of spatial attention in infancy. , 2015, Infancy : the official journal of the International Society on Infant Studies.

[5]  Jochen Triesch,et al.  What Leads To Shared Attention? Maternal Cues and Infant Responses During Object Play , 2018 .

[6]  Frédéric Kaplan,et al.  Learning to Interpret Pointing Gestures: Experiments with Four-Legged Autonomous Robots , 2005, Biomimetic Neural Learning for Intelligent Robots.

[7]  Takayuki Kanda,et al.  Natural deictic communication with humanoid robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Elizabeth Bates,et al.  The Acquisition of Performatives Prior to Speech. , 1975 .

[9]  Ty W. Boyer,et al.  When do infants begin to follow a point? , 2014, Developmental psychology.

[10]  Gregor Schöner,et al.  Dynamic Thinking : A Primer on Dynamic Field Theory , 2015 .

[11]  Gregor Schöner,et al.  What does theoretical neuroscience have to offer the study of behavioral development?:Insights from a dynamic field theory of spatial cognition , 2007 .

[12]  Jon Driver,et al.  Adult's Eyes Trigger Shifts of Visual Attention in Human Infants , 1998 .

[13]  Yukie Nagai,et al.  The Role of Motion Information in Learning Human-Robot Joint Attention , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  Moritz M. Daum,et al.  The development of pointing perception in infancy: effects of communicative signals on covert shifts of attention. , 2013, Developmental psychology.

[15]  Holger Diessel,et al.  Demonstratives: Form, function and grammaticalization , 1999 .

[16]  Jan Theeuwes,et al.  OpenSesame: An open-source, graphical experiment builder for the social sciences , 2011, Behavior Research Methods.

[17]  B. Bertenthal,et al.  Dynamic pointing triggers shifts of visual attention in young infants. , 2012, Developmental science.

[18]  A. Cangelosi,et al.  Symbol grounding and the symbolic theft hypothesis , 2002 .

[19]  A. Cangelosi,et al.  From Babies to Robots: The Contribution of Developmental Robotics to Developmental Psychology , 2018 .

[20]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[21]  Alessandro Roncone,et al.  A Cartesian 6-DoF Gaze Controller for Humanoid Robots , 2016, Robotics: Science and Systems.

[22]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[23]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[24]  V. Volterra,et al.  Gestures and words during the transition to two-word speech , 1996, Journal of Child Language.

[25]  Minoru Asada,et al.  A constructive model for the development of joint attention , 2003, Connect. Sci..

[26]  Angelo Cangelosi,et al.  Coupling Dynamical and Connectionist Models: Representation of Spatial Attention via Learned Deictic Gestures in Human-Robot Interaction , 2018, CogSci.