From learning to new goal generation in a bioinspired robotic setup

In the field of cognitive bioinspired robotics, we focus on autonomous development, and propose a possible model to explain how humans generate and pursue new goals that are not strictly dictated by survival. Autonomous lifelong learning is an important ability for robots to make them able to acquire new skills, and autonomous goal generation is a basic mechanism for that. The Intentional Distributed Robotic Architecture (IDRA) here presented intends to allow the autonomous development of new goals in situated agents starting from some simple hard-coded instincts. It addresses this capability through an imitation of the neural plasticity, the property of the cerebral cortex supporting learning. Three main brain areas are involved in goal generation, cerebral cortex, thalamus, and amygdala; these are mimicked at a functional level by the modules of our computational model, namely Deliberative, Working-Memory, Goal-Generator, and Instincts Modules, all connected in a network. IDRA has been designed to be robot independent; we have used it in simulation and on the real Aldebaran NAO humanoid robot. The reported experiments explore how basic capabilities, as active sensing, are obtained by the architecture. Graphical Abstract

[1]  Antonio Chella,et al.  AGI and Machine Consciousness , 2012 .

[2]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[3]  J. Doyon,et al.  Contributions of the basal ganglia and functionally related brain structures to motor learning , 2009, Behavioural Brain Research.

[4]  Tamar Flash,et al.  Motor primitives in vertebrates and invertebrates , 2005, Current Opinion in Neurobiology.

[5]  Marco Mirolli,et al.  Intrinsically Motivated Learning in Natural and Artificial Systems , 2013 .

[6]  D. Long Networks of the Brain , 2011 .

[7]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[8]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[9]  Riccardo Manzotti,et al.  Bio-inspired Classification in the Architecture of Situated Agents , 2014, IAS.

[10]  L. F. Barrett,et al.  The role of the amygdala in visual awareness , 2007, Trends in Cognitive Sciences.

[11]  M. Matarić Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior , 1998, Trends in Cognitive Sciences.

[12]  R. Guillery,et al.  Exploring the Thalamus , 2000 .

[13]  A. Barto,et al.  Intrinsic motivations and open-ended development in animals, humans, and robots: an overview , 2014, Front. Psychol..

[14]  J. Hawkins,et al.  On Intelligence , 2004 .

[15]  Raymond J. Dolan,et al.  Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot , 2014, Front. Psychol..

[16]  R. Adolphs,et al.  Role of the amygdala in processing visual social stimuli. , 2006, Progress in brain research.

[17]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[18]  Nicholas J. Butko,et al.  Active perception , 2010 .

[19]  Ben Goertzel,et al.  Theoretical Foundations of Artificial General Intelligence , 2012, Atlantis Thinking Machines.

[20]  Flavio Mutti,et al.  A bioinspired intentional architecture for situated agents to explore human cognitive abilities , 2014 .

[21]  Jürgen Leitner,et al.  Curiosity driven reinforcement learning for motion planning on humanoids , 2014, Front. Neurorobot..

[22]  D. Modha,et al.  Network architecture of the long-distance pathways in the macaque brain , 2010, Proceedings of the National Academy of Sciences.

[23]  Marco Mirolli,et al.  Which is the best intrinsic motivation signal for learning multiple skills? , 2013, Front. Neurorobot..

[24]  W. T. Powers,et al.  A General Feedback Theory of Human Behavior: Part I , 1960 .

[25]  J. Albus A Theory of Cerebellar Function , 1971 .

[26]  Giuseppina Gini,et al.  The Organization of Cortex-Ganglia-Thalamus to Generate Movements From Motor Primitives: a Model for Developmental Robotics , 2015, AIRO@AI*IA.

[27]  Dileep George,et al.  How the brain might work: a hierarchical and temporal model for learning and recognition , 2008 .

[28]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[29]  Alessandra Angelucci,et al.  Induction of visual orientation modules in auditory cortex , 2000, Nature.

[30]  G. E. Alexander,et al.  Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. , 1990, Progress in brain research.

[31]  Riccardo Manzotti,et al.  Intentional change, intrinsic motivations, and goal generation , 2014, Behavioral and Brain Sciences.

[32]  Jürgen Schmidhuber,et al.  Optimal Artificial Curiosity, Creativity, Music, and the Fine Arts , 2005 .

[33]  G. Palli Intelligent Robots And Systems , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[34]  Soo-Young Lee,et al.  Cognitive Integration through Goal-Generation in a Robotic Setup , 2012, BICA.

[35]  Giuseppina Gini,et al.  Visuomotor Mapping Based on Hering's Law for a Redundant Active Stereo Head and a 3 DOF Arm , 2012, BIONETICS.

[36]  Patricia Shaw,et al.  From Saccades to Grasping: A Model of Coordinated Reaching Through Simulated Development on a Humanoid Robot , 2014, IEEE Transactions on Autonomous Mental Development.

[37]  Andrew G. Barto,et al.  Intrinsic Motivation and Reinforcement Learning , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[38]  Kathryn E. Merrick,et al.  Intrinsic Motivation and Introspection in Reinforcement Learning , 2012, IEEE Transactions on Autonomous Mental Development.

[39]  Pierre-Yves Oudeyer,et al.  Self-organization of early vocal development in infants and machines: the role of intrinsic motivation , 2014, Front. Psychol..

[40]  Riccardo Manzotti,et al.  From behaviour-based robots to motivation-based robots , 2005, Robotics Auton. Syst..

[41]  S. Giszter,et al.  Modular Premotor Drives and Unit Bursts as Primitives for Frog Motor Behaviors , 2004, The Journal of Neuroscience.

[42]  D. Bjorklund Children's thinking : cognitive development and individual differences / David F. Bjorklund , 2005 .

[43]  Aapo Hyvärinen,et al.  Independent component analysis: recent advances , 2013, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[44]  M. Sur,et al.  Rewiring cortex: the role of patterned activity in development and plasticity of neocortical circuits. , 1999, Journal of neurobiology.

[45]  Kenji Suzuki,et al.  Motivation oriented action selection for understanding dynamics of objects , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.