A grand challenge for computational intelligence a micro-environment benchmark for adaptive autonomous intelligent agents

Being able to acquire knowledge and form concepts by observing, exploring, and interacting with the environment and then applying the knowledge thus gained for problem solving to satisfy its goals and needs is the hallmark of an adaptive autonomous intelligent agent. However, for an intelligent agent to be fully autonomous and adaptive, all aspects of intelligent processing from perception to action must be engaged and integrated. To build such an all-encompassing system is a formidable task. We propose that a good approach is to first identify the necessary intelligent computational structures and processes for dealing with a suitably designed micro-environment so that they are tractable. The challenge for computational intelligence is then to uncover general principles leading to general computational structures and processes that can deal with the micro-environment and that are also scalable to deal with more complex and real-world environments. Neuroscience research revealed that there are indeed such scalable general mechanisms in the brain and this is reviewed to provide inspirations for the building of artificial systems. A suitable micro-environment for this purpose must consist of a minimal set of features necessary to engage the various intelligent processes from that of the perceptual to that of the attentional, memory, affective, conceptual, planning, action, and learning. The micro-environment benchmark we propose here consists of an internal environment including the affective states of the intelligent agent as well as an external environment that is dynamic and in which activities of and interactions between objects can take place to engage the intelligent agent in all the intelligent processes described above.

[1]  J. Houk On the role of the cerebellum and basal ganglia in cognitive signal processing. , 1997, Progress in brain research.

[2]  Dileep George,et al.  How the brain might work: a hierarchical and temporal model for learning and recognition , 2008 .

[3]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[4]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[5]  B. Raphael The Thinking Computer , 1976 .

[6]  Alan C. Evans,et al.  Abnormal basal ganglia outflow in Parkinson's disease identified with PET. Implications for higher cortical functions. , 1998, Brain : a journal of neurology.

[7]  Seng-Beng Ho,et al.  The Atoms of Cognition: A Theory of Ground Epistemics , 2012, CogSci.

[8]  P. Strick,et al.  Cerebellum and nonmotor function. , 2009, Annual review of neuroscience.

[9]  Apostolos P. Georgopoulos,et al.  Motor Functions of the Basal Ganglia , 2011 .

[10]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[11]  Eric Courchesne,et al.  Differential effects of developmental cerebellar abnormality on cognitive and motor functions in the cerebellum: an fMRI study of autism. , 2003, The American journal of psychiatry.

[12]  James C. Houk,et al.  Agents of the mind , 2005, Biological Cybernetics.

[13]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[14]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[15]  Terry Winograd,et al.  Understanding natural language , 1974 .

[16]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[17]  M. Glickstein,et al.  Mossy-fibre sensory input to the cerebellum. , 1997, Progress in brain research.

[18]  G. Allen,et al.  Cerebrocerebellar communication systems. , 1974, Physiological reviews.

[19]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[20]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[21]  Steven L. Thorne,et al.  Rising mean IQ: Cognitive demand of mathematics education for young children, population exposure to formal schooling, and the neurobiology of the prefrontal cortex , 2005 .

[22]  D. Stuss,et al.  Cognitive neuroscience. , 1993, Current opinion in neurobiology.

[23]  P. Strick,et al.  Activation of a cerebellar output nucleus during cognitive processing. , 1994, Science.

[24]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[25]  N. Andreasen,et al.  The Role of the Cerebellum in Schizophrenia , 2008, Biological Psychiatry.

[26]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  C. Marsden,et al.  The behavioural and motor consequences of focal lesions of the basal ganglia in man. , 1994, Brain : a journal of neurology.

[28]  M. Sur,et al.  Experimentally induced visual projections into auditory thalamus and cortex. , 1988, Science.

[29]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[30]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[31]  Carol A. Seger,et al.  How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback , 2008, Neuroscience & Biobehavioral Reviews.

[32]  R. Douglas,et al.  Mapping the Matrix: The Ways of Neocortex , 2007, Neuron.

[33]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[34]  Erik J. Peterson,et al.  Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling , 2010, NeuroImage.

[35]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[36]  W. T. Thach,et al.  Cerebellar Control of Posture and Movement , 2011 .

[37]  Masao Ito Control of mental activities by internal models in the cerebellum , 2008, Nature Reviews Neuroscience.

[38]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.