Towards Learning by Interacting

Traditional robotics has treated the question of learning as a one way process: learning algorithms, especially imitation learning approaches, are based on observing and analysing the environment before carrying out the `learned' action. In such scenarios the learning situation is restricted to uni-directional communication. However, insights into the process of infant learning more and more reveal that interaction plays a major role in transferring relevant information to the learner. For example, in learning situations, the interactive situation has the potential to highlight parts of an action by linguistic and non-linguistic features and thus to guide the attention of the learner to those aspects that the tutor deems relevant for her current state of mind. We argue that learning necessarily needs to be embedded in an interactive situation and that developmental robotics, in order to model engagement in interaction, needs to take the communicative context into account. We further propose that such an approach necessarily needs to take three aspects into account: (1) multi-modal integration at all processing levels (2) derivation of top-down strategies from bottom-up processes and (3) integration of single modules into an interactive system in order to facilite the first two desiderata.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  J. Watson Smiling, cooing, and "the game." , 1972 .

[3]  L. Gogate,et al.  Intersensory Redundancy and 7-Month-Old Infants' Memory for Arbitrary Syllable-Object Relations , 2001 .

[4]  N. Masataka The onset of language , 2003 .

[5]  P. Schönemann On artificial intelligence , 1985, Behavioral and Brain Sciences.

[6]  R. Sun Desiderata for cognitive architectures , 2004 .

[7]  Mark H. Johnson,et al.  Infants' use of gaze direction to cue attention: The importance of perceived motion , 2000 .

[8]  Jon Driver,et al.  Adult's Eyes Trigger Shifts of Visual Attention in Human Infants , 1998 .

[9]  Mark H. Johnson,et al.  Biology and Cognitive Development: The Case of Face Recognition , 1993 .

[10]  Brian Scassellati,et al.  A Behavioral Analysis of Computational Models of Visual Attention , 2007, International Journal of Computer Vision.

[11]  K. Hirsh-Pasek,et al.  A change is afoot: emergentist thinking in language acquisition , 2000 .

[12]  N. Masataka The Onset of Language: List of tables , 2003 .

[13]  T. Ziemke What’s that Thing Called Embodiment? , 2003 .

[14]  Mark H. Johnson,et al.  Processes of change in brain and cognitive development , 2005, Trends in Cognitive Sciences.

[15]  Minoru Asada,et al.  Joint attention emerges through bootstrap learning , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  B. Scassellati Imitation and mechanisms of joint attention: a developmental structure for building social skills on a humanoid robot , 1999 .

[17]  Alan Davies,et al.  Handbook of Applied Linguistics , 2003 .

[18]  Keiichiro Hoashi,et al.  Humanoid Robots in Waseda University—Hadaly-2 and WABIAN , 2002, Auton. Robots.

[19]  P. Kuhl Is speech learning 'gated' by the social brain? , 2007, Developmental science.

[20]  Oliver Lemon,et al.  Author manuscript, published in "European Conference on Speech Communication and Technologies (Interspeech'07), Anvers: Belgium (2007)" Machine Learning for Spoken Dialogue Systems , 2022 .

[21]  R. Panneton,et al.  Four-Month-Olds' Discrimination of Voice Changes in Multimodal Displays as a Function of Discrimination Protocol. , 2005, Infancy : the official journal of the International Society on Infant Studies.

[22]  Patricia Zukow-Goldring Action to Language via the Mirror Neuron System: Assisted imitation: affordances, effectivities, and the mirror system in early language development , 2006 .

[24]  C. Moore,et al.  Joint attention : its origins and role in development , 1995 .

[25]  Dare A. Baldwin,et al.  Understanding the link between joint attention and language. , 1995 .

[26]  Y. Nagai Joint Attention Development in Infant-like Robot based on Head Movement Imitation , 2005 .

[27]  Brian R. Duffy,et al.  INTELLIGENT ROBOTS: THE QUESTION OF EMBODIMENT , 2000 .

[28]  H. H. Clark Arenas of language use , 1993 .

[29]  K. Dautenhahn,et al.  Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions , 2009 .

[30]  Shuyin Li,et al.  Multi-modal interaction management for a robot companion , 2007 .

[31]  G. Csibra,et al.  Social learning and social cognition: The case for pedagogy , 2006 .

[32]  Kathy Hirsh-Pasek,et al.  Baby Wordsmith , 2006 .

[33]  Kathy Hirsh-Pasek,et al.  The Origins of Grammar: Evidence from Early Language Comprehension , 1999 .

[34]  M. Posner The Cognitive Neuroscience of Attention , 2020 .

[35]  C. Moore,et al.  The role of movement in the development of joint visual attention , 1997 .

[36]  Brian Scassellati,et al.  A Context-Dependent Attention System for a Social Robot , 1999, IJCAI.

[37]  P. Green Biology and Cognitive Development: the Case of Face Recognition, Mark H. Johnson, John Morton. Blackwell, Oxford (1991), x, +180. Price £35.00 hardback, £10.95 paperback , 1992 .

[38]  Joseph A. Driscoll,et al.  A visual attention network for a humanoid robot , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[39]  A. Fogel,et al.  Alive communication. , 2007, Infant Behavior and Development.

[40]  M. Arbib Action to language via the mirror neuron system , 2006 .

[41]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[42]  Nobuo Masataka The Onset of Language by Nobuo Masataka , 2003 .

[43]  B. Scassellati Imitation and Mechanisms of Shared Attention: A Developmental Structure for Building Social Skills , 2007 .

[44]  F. Kaplan,et al.  The challenges of joint attention , 2006 .