Towards learning 2.0

Learning certainly qualifies as one of the core issues of artificial intelligence (AI). During the years, it has gained - and subsequently lost - popularity in the research community. After a historical perspective on the rise and fall of learning research in AI, some of the limitations of current learning systems are reviewed, followed by a presentation of various responses about how to overcome them. A special focus is given on one of the responses, the attempt to draw lessons from a detailed study of evolutionary and developmental processes and stages of learning in nature, in particular in human beings. From this, a number of principles for machine learning are inferred. A key aspect seems to be that learning should be cumulative to compensate for the exponential growth in learning complexity.

[1]  H. C. Plotkin,et al.  Darwin machines and the nature of knowledge , 1994 .

[2]  Raymond C. Kurzweil,et al.  The Singularity Is Near , 2018, The Infinite Desire for Growth.

[3]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[4]  G. Ferro-Luzzi.  On Evolutionary Epistemology , 1982, Current Anthropology.

[5]  H. Simon,et al.  The shape of automation for men and management , 1965 .

[6]  C. Gallistel,et al.  Lessons from animal learning for the study of cognitive development , 1991 .

[7]  Ramanathan V. Guha,et al.  Cyc: toward programs with common sense , 1990, CACM.

[8]  H. Plotkin.  An Evolutionary Epistemological Approach to the Evolution of Intelligence , 1988 .

[9]  Dietmar Bruckner,et al.  Probabilistic models in building automation: recognizing scenarios with statistical methods , 2008 .

[10]  H. Markram.  The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[11]  Ronald L. Rivest,et al.  Training a 3-node neural network is NP-complete , 1988, COLT '88.

[12]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[13]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[14]  David G. Stork,et al.  Hal's Legacy: 2001's Computer as Dream and Reality , 1996 .

[15]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[16]  R. Kurzweil,et al.  The Singularity Is Near: When Humans Transcend Biology , 2006 .

[17]  Peter Palensky,et al.  Project ARS - the next step towards an intelligent environment , 2005 .

[18]  K. Nelson,et al.  Event knowledge : structure and function in development , 1986 .

[19]  Etienne Barnard,et al.  Invariance and neural nets , 1991, IEEE Trans. Neural Networks.

[20]  A. Jonker.  Origins of the modern mind. Three stages in the evolution of culture and cognition , 1998 .

[21]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[22]  J. Mycielski.  Review: Marvin Minsky and Seymour Papert, Perceptrons, An Introduction to Computational Geometry , 1972 .

[23]  David H. Wolpert,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[24]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[25]  Vernor Vinge,et al.  ==================================================================== the Coming Technological Singularity: How to Survive in the Post-human Era , 2022 .

[26]  Eric B. Baum,et al.  What is thought? , 2003 .

[27]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[28]  David G. Stork,et al.  Pattern Classification , 1973 .

[29]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[30]  Thomas R. Zentall,et al.  IMITATION IN ANIMALS: EVIDENCE, FUNCTION, AND MECHANISMS , 2001, Cybern. Syst..

[31]  Rodney Brooks,et al.  I, Rodney Brooks, am a robot , 2008, IEEE Spectrum.

[32]  Ben Goertzel,et al.  OpenCog: A Software Framework for Integrative Artificial General Intelligence , 2008, AGI.

[33]  Katherine Nelson,et al.  Language In Cognitive Development , 1996 .

[34]  S. Pinker.  The Language Instinct , 1994 .