Motivation in Embodied Intelligence

Before artificial intelligence set its mind on developing abstract intelligent agents which can think, Alan Turing suggested training embodied machines equipped with sensors and actuators to accomplish intelligent tasks like understanding spoken English (Turing, 1950). Looking at intelligence from a different perspective, philosopher, and neuroscientist Francisco Varela (Maturana & Varela, 1980), (Varela et al., 1992) proposed the embodied philosophy of living systems which argues that human cognition can only be understood in terms of the human body and the physical environment with which it interacts. What may seem to be a revelation from a historical perspective, early robots built on cybernetic principles demonstrated goal-seeking behavior, homeostasis (the ability to keep parameters within prescribed ranges), and learning abilities (Walter, 1951), (Walter, 1953). These were precursors for embodied intelligence. Perhaps the most influential figure in developing embodied intelligence as a methodology to design intelligent machines is Rodney Brooks. He suggested the design of intelligent machines through interaction with the environment driven by perception and action, rather than by a prespecified algorithm (Brooks, 1991a). Like Hans Moravec before him (Moravec, 1984), Brooks suggested that locomotion and vision are fundamental for natural intelligence. He also observed that the environment is its best model and that representation is the wrong “unit of abstraction”. These simple observations revolutionized the way people think about intelligent machines and created a field of research called “embodied intelligence”. The growth of interest in embodied intelligence that followed Brooks’ works can be compared to the increase in research activities in artificial intelligence that followed the famous Dartmouth Conference of 1956 (McCarthy et al., 1955) or the revival of neural network research in the 1980s. His approach revived the field of autonomous robots, but as robotics thrived, research on embodied intelligence started to concentrate on the commercial aspects of robots with a lot of effort spent on embodiment and a little on intelligence. The open question remains: how to continue on the path to machine intelligence? Today, once again, artificial intelligence research is focused on specialized problems, such as ways to represent knowledge, natural language and scene understanding, semantic cognition, question answering, associative memories or various forms or reinforcement learning. In recent years, the term “general artificial intelligence” was coined as something new, incorrectly implying that the original idea of AI was something less than to develop a natural intelligence.

[1]  Principia Ethica , 1922, Nature.

[2]  W. Walter A Machine that Learns , 1951 .

[3]  W. Walter The Living Brain , 1963 .

[4]  Verzekeren Naar Sparen,et al.  Cambridge , 1969, Humphrey Burton: In My Own Time.

[5]  J. Marshall THE SKIN SENSES , 1969 .

[6]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[7]  H. Maturana,et al.  Autopoiesis and Cognition : The Realization of the Living (Boston Studies in the Philosophy of Scie , 1980 .

[8]  Richard S. Sutton,et al.  Temporal credit assignment in reinforcement learning , 1984 .

[9]  E. Rolls Functions of neuronal networks in the hippocampus and neocortex in memory , 1989 .

[10]  R. Melzack Pain and the neuromatrix in the brain. , 2001, Journal of dental education.

[11]  M M Mesulam,et al.  Large‐scale neurocognitive networks and distributed processing for attention, language, and memory , 1990, Annals of neurology.

[12]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[13]  David Chapman,et al.  What are plans for? , 1990, Robotics Auton. Syst..

[14]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[15]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[16]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[17]  E. Rosch,et al.  The Embodied Mind: Cognitive Science and Human Experience , 1993 .

[18]  Austin Tate,et al.  O-Plan: The open Planning Architecture , 1991, Artif. Intell..

[19]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[20]  Geoffrey E. Hinton,et al.  Feudal Reinforcement Learning , 1992, NIPS.

[21]  J. Stewart,et al.  Cognition without Neurones: Adaptation, Learning and Memory in the Immune System , 1993 .

[22]  M. Csíkszentmihályi Creativity: Flow and the Psychology of Discovery and Invention , 1996 .

[23]  D. Yellon,et al.  Angina reassessed: pain or protector? , 1996, The Lancet.

[24]  Stuart J. Russell,et al.  Reinforcement Learning with Hierarchies of Machines , 1997, NIPS.

[25]  Anthony K. P. Jones,et al.  Pain processing during three levels of noxious stimulation produces differential patterns of central activity , 1997, Pain.

[26]  B Conrad,et al.  Region‐specific encoding of sensory and affective components of pain in the human brain: A positron emission tomography correlation analysis , 1999, Annals of neurology.

[27]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[28]  Thomas G. Dietterich Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition , 1999, J. Artif. Intell. Res..

[29]  Jennie Si,et al.  Online learning control by association and reinforcement , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[30]  R. Peyron,et al.  Functional imaging of brain responses to pain. A review and meta-analysis (2000) , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[31]  Jen-Chuen Hsieh,et al.  Activation of the hypothalamus characterizes the acupuncture stimulation at the analgesic point in human: a positron emission tomography study , 2001, Neuroscience Letters.

[32]  A. Morton The architecture of reason: The Structure and Substance of Rationality By Robert Audi, New York: Oxford University Press, 2001. 286 pages. , 2002, Philosophy.

[33]  G. Pagnoni,et al.  Does Anticipation of Pain Affect Cortical Nociceptive Systems? , 2002, The Journal of Neuroscience.

[34]  Luc Steels,et al.  The Autotelic Principle , 2003, Embodied Artificial Intelligence.

[35]  G. Cullity,et al.  The architecture of reason : the structure and substance of rationality , 2003 .

[36]  L. Steels Intelligence with representation , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[37]  R. Wehner ‘Matched filters’ — neural models of the external world , 1987, Journal of Comparative Physiology A.

[38]  Satinder Singh Transfer of learning by composing solutions of elemental sequential tasks , 2004, Machine Learning.

[39]  Nuttapong Chentanez,et al.  Intrinsically Motivated Learning of Hierarchical Collections of Skills , 2004 .

[40]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[41]  Shane Legg,et al.  A Formal Measure of Machine Intelligence , 2006, ArXiv.

[42]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[43]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[44]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.