Do Machine-Learning Machines Learn?

We answer the present paper’s title in the negative. We begin by introducing and characterizing “real learning” (\(\mathcal {RL}\)) in the formal sciences, a phenomenon that has been firmly in place in homes and schools since at least Euclid. The defense of our negative answer pivots on an integration of reductio and proof by cases, and constitutes a general method for showing that any contemporary form of machine learning (ML) isn’t real learning. Along the way, we canvass the many different conceptions of “learning” in not only AI, but psychology and its allied disciplines; none of these conceptions (with one exception arising from the view of cognitive development espoused by Piaget), aligns with real learning. We explain in this context by four steps how to broadly characterize and arrive at a focus on \(\mathcal {RL}\).

[1]  Nick Bostrom,et al.  Future Progress in Artificial Intelligence: A Survey of Expert Opinion , 2013, PT-AI.

[2]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[3]  Emanuel Kitzelmann,et al.  Inductive Programming: A Survey of Program Synthesis Techniques , 2009, AAIP.

[4]  N. Mackintosh,et al.  Conditioning And Associative Learning , 1983 .

[5]  George F. Luger,et al.  Artificial intelligence - structures and strategies for complex problem solving (2. ed.) , 1993 .

[6]  Selmer Bringsjord,et al.  Superminds: People Harness Hypercomputation, and More , 2003 .

[7]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[8]  Selmer Bringsjord,et al.  What is Artificial Intelligence? Psychometric AI as an Answer , 2003, IJCAI.

[9]  Selmer Bringsjord,et al.  What Robots Can and Can’t Be , 1992 .

[10]  Elaine J. Weyuker,et al.  Computability, complexity, and languages - fundamentals of theoretical computer science , 2014, Computer science and applied mathematics.

[11]  A. Bandura,et al.  Developmental psychology : Bandura , Ross and Ross ( 1961 ) Transmission of aggression through imitation of aggressive models , 2015 .

[12]  Derek C. Penn,et al.  Darwin's mistake: Explaining the discontinuity between human and nonhuman minds , 2008, Behavioral and Brain Sciences.

[13]  Selmer Bringsjord Chess Is Too Easy. , 1998 .

[14]  P. Johnson-Laird,et al.  Psychology of Reasoning: Structure and Content , 1972 .

[15]  Selmer Bringsjord,et al.  The modal argument for hypercomputing minds , 2004, Theor. Comput. Sci..

[16]  John E. Hummel,et al.  Symbolic Versus Associative Learning , 2010, Cogn. Sci..

[17]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[18]  David R. Musser,et al.  Fundamental Proof Methods in Computer Science: A Computer-Based Approach , 2017 .

[19]  Richard H. Lathrop,et al.  On the Learnability of the Uncomputable , 1996, ICML.

[20]  Robert H. Sloan,et al.  BOOK REVIEW: "SYSTEMS THAT LEARN: AN INTRODUCTION TO LEARNING THEORY, SECOND EDITION", SANJAY JAIN, DANIEL OSHERSON, JAMES S. ROYER and ARUN SHARMA , 2001 .

[21]  Selmer Bringsjord,et al.  Computers, Justification, and Mathematical Knowledge , 2007, Minds and Machines.

[22]  E. Mark Gold,et al.  Limiting recursion , 1965, Journal of Symbolic Logic.

[23]  Selmer Bringsjord,et al.  The symbol grounding problem … remains unsolved , 2015, J. Exp. Theor. Artif. Intell..

[24]  San Cristóbal Mateo,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996 .

[25]  Dirk P. Kroese,et al.  Statistical Learning , 2001, Science.

[26]  Edmund L. Gettier Is Justified True Belief Knowledge? , 1963, Arguing About Knowledge.

[27]  Robert C. Moore Making the transition to formal proof , 1994 .

[28]  Hilary Putnam,et al.  Trial and error predicates and the solution to a problem of Mostowski , 1965, Journal of Symbolic Logic.

[29]  Umesh V. Vazirani,et al.  An Introduction to Computational Learning Theory , 1994 .

[30]  Konstantinos Arkoudas Denotational proof languages , 2000 .

[31]  J. Piaget,et al.  The Growth Of Logical Thinking From Childhood To Adolescence: An Essay On The Construction Of Formal Operational Structures , 1958 .

[32]  Selmer Bringsjord,et al.  Real Robots and the Missing Thought-Experiment in the Chinese Room Dialectic , 2003 .

[33]  Konrad P. Kording,et al.  Towards an integration of deep learning and neuroscience , 2016, bioRxiv.

[34]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[35]  George F. Luger,et al.  AI Algorithms, Data Structures, and Idioms in Prolog, Lisp, and Java for Artificial Intelligence: Structures and Strategies for Complex Problem Solving , 2008 .

[36]  Vincent C. Mller Fundamental Issues of Artificial Intelligence - 2nd Conference on Philosophy and Theory of Artificial Intelligence, PT-AI 2013, Oxford, UK, September 21-22, 2013, selected and invited papers , 2016, PT-AI.

[37]  Immaterial Aspects of Thought , 1992 .

[38]  Emmanuel Bacry,et al.  Uncovering Causality from Multivariate Hawkes Integrated Cumulants , 2016, ICML.

[39]  R. L. Goodstein,et al.  On the restricted ordinal theorem , 1944, Journal of Symbolic Logic.

[40]  T. Rado On non-computable functions , 1962 .

[41]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[42]  L. Barrett,et al.  Beyond The Brain: How Body and Environment Shape Animal and Human Minds , 2013 .

[43]  Selmer Bringsjord,et al.  Psychometric artificial intelligence , 2011, J. Exp. Theor. Artif. Intell..

[44]  N. Brunel,et al.  Toward a Neurocentric View of Learning , 2017, Neuron.

[45]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[46]  Konrad P. Körding,et al.  Toward an Integration of Deep Learning and Neuroscience , 2016, bioRxiv.

[47]  Selmer Bringsjord,et al.  A new Gödelian argument for hypercomputing minds based on the busy beaver problem , 2006, Appl. Math. Comput..

[48]  Selmer Bringsjord,et al.  In defense of logical minds , 1998 .