The conceptual basis of function learning and extrapolation: Comparison of rule-based and associative-based models

The purpose of this article is to provide a foundation for a more formal, systematic, and integrative approach to function learning that parallels the existing progress in category learning. First, we note limitations of existing formal theories. Next, we develop several potential formal models of function learning, which include expansion of classic rule-based approaches and associative-based models. We specify for the first time psychologically based learning mechanisms for the rule models. We then present new, rigorous tests of these competing models that take into account order of difficulty for learning different function forms and extrapolation performance. Critically, detailed learning performance was also used to conduct the model evaluations. The results favor a hybrid model that combines associative learning of trained input—prediction pairs with a rule-based output response for extrapolation (EXAM).

[1]  K. R. Hammond Probabilistic functioning and the clinical method. , 1955, Psychological review.

[2]  P. Hoffman The paramorphic representation of clinical judgment. , 1960, Psychological bulletin.

[3]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[4]  J. Carroll FUNCTIONAL LEARNING: THE LEARNING OF CONTINUOUS FUNCTIONAL MAPPINGS RELATING STIMULUS AND RESPONSE CONTINUA , 1963 .

[5]  C. N. Uhl LEARNING OF INTERVAL CONCEPTS: I. EFFECTS OF DIFFERENCES IN STIMULUS WEIGHTS. , 1963, Journal of experimental psychology.

[6]  Roger L. Dominowski,et al.  The psychology of thinking , 1971 .

[7]  Berndt Brehmer,et al.  Single-cue probability learning as a function of the sign and magnitude of the correlation between cue and criterion , 1973 .

[8]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[9]  B. Brehmer Hypotheses about relations between scaled variables in the learning of probabilistic inference tasks , 1974 .

[10]  W. A. Wagenaar,et al.  Misperception of exponential growth , 1975 .

[11]  R. L. Solso Theories in cognitive psychology : the Loyola symposium , 1975 .

[12]  J.A. Anderson,et al.  Theory of categorization based on distributed memory storage. , 1984 .

[13]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[14]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[15]  Kurt Hornik,et al.  FEED FORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS , 1989 .

[16]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[17]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[18]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[19]  D. Meyer,et al.  Function learning: induction of continuous stimulus-response relations. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[20]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[21]  John K. Kruschke,et al.  Investigations of an Exemplar-Based Connectionist Model of Category Learning , 1992 .

[22]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[23]  B. Ross,et al.  Concepts and Categories , 1994 .

[24]  William K. Estes,et al.  Classification and cognition , 1994 .

[25]  Eunhee Byun,et al.  Interaction between prior knowledge and type of nonlinear relationship on function learning , 1995 .

[26]  M. McDaniel,et al.  The Abstraction of Intervening Concepts from Experience with Multiple Input–Multiple Output Causal Environments , 1997, Cognitive Psychology.

[27]  M. McDaniel,et al.  Extrapolation: the sine qua non for abstraction in function learning. , 1997 .

[28]  Michael H. Birnbaum,et al.  Measurement, judgment, and decision making , 1998 .

[29]  F. Gregory Ashby,et al.  Chapter 4 – Stimulus Categorization , 1998 .

[30]  H. Bozdogan,et al.  Akaike's Information Criterion and Recent Developments in Information Complexity. , 2000, Journal of mathematical psychology.

[31]  T. R. Stewart,et al.  The essential brunswik: Beginnings, explications, applications. , 2001 .

[32]  A. Efland,et al.  Art and cognition , 2002 .

[33]  M. Kalish,et al.  Simplified learning in complex situations: knowledge partitioning in function learning. , 2002, Journal of experimental psychology. General.

[34]  P. Juslin,et al.  Exemplar effects in categorization and multiple-cue judgment. , 2003, Journal of experimental psychology. General.

[35]  Lewis Bott,et al.  Nonmonotonic extrapolation in function learning. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[36]  Stephan Lewandowsky,et al.  Population of linear experts: knowledge partitioning and function learning. , 2004, Psychological review.

[37]  Emmanuel Guigon Interpolation and Extrapolation in Human Behavior and Neural Networks , 2004, Journal of Cognitive Neuroscience.

[38]  J. Busemeyer,et al.  Learning Functional Relations Based on Experience With Input-Output Pairs by Humans and Artificial Neural Networks , 2005 .