A comprehensive model of development on the balance-scale task

We present a new model of children's performance on the balance-scale task, one of the most common benchmarks for computational modeling of psychological development. The model is based on intuitive and torque-rule modules, each implemented as a constructive neural network. While the intuitive module recruits non-linear sigmoid units as it learns to solve the task, the second module can additionally recruit a neurally-implemented torque rule, mimicking the explicit teaching of torque in secondary-school science classrooms. A third, selection module decides whether the intuitive module is likely to yield a correct response or whether the torque-rule module should be invoked on a given balance-scale problem. The model progresses through all four stages seen in children, ending with a genuine torque rule that can solve untrained problems that are only solvable by comparing torques. The model also simulates the torque-difference effect and the pattern of human response times, faster on simple problems than on conflict problems. The torque rule is more likely to be invoked on conflict problems than on simple problems and its emergence requires both explicit teaching and practice. Overlapping waves of rule-based stages are also covered by the model. Appendices report evidence that constructive neural networks can also acquire a genuine torque rule from examples alone and show that Latent Class Analysis often finds small, unreliable rule classes in both children and computational models. Consequently, caution in using Latent Class Analysis for rule diagnosis is suggested to avoid emphasis on rule classes that cannot be replicated.

[1]  Thomas R. Schultz,et al.  A Connectionist Model of the Development of Transitivity , 2004 .

[2]  M. Tan,et al.  Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. , 1996, Biometrics.

[3]  Charles X. Ling,et al.  A Decision-Tree Model of Balance Scale Development , 2004, Machine Learning.

[4]  Brenda R. J. Jansen,et al.  Re-thinking stages of cognitive development: An appraisal of connectionist models of the balance scale task , 2007, Cognition.

[5]  Thomas R. Shultz,et al.  A Model of Infant Learning of Word Stress , 2005 .

[6]  Thomas R. Shultz,et al.  A connectionist model of the learning of personal pronouns in English , 1994, COLT 1994.

[7]  Luke J. Chang,et al.  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Multiple Systems in Decision Making , 2022 .

[8]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[9]  R. Siegler,et al.  Differentiation and integration: guiding principles for analyzing cognitive change. , 2008, Developmental science.

[10]  D. Bartholomew Latent Variable Models And Factor Analysis , 1987 .

[11]  L. A. Goodman Exploratory latent structure analysis using both identifiable and unidentifiable models , 1974 .

[12]  A. Reber Implicit learning and tacit knowledge , 1993 .

[13]  H.L.J. van der Maas,et al.  How to detect cognitive strategies: commentary on 'Differentiation and integration: guiding principles for analyzing cognitive change'. , 2008, Developmental science.

[14]  Yoshio Takane,et al.  Rule following and rule use in the balance-scale task , 2007, Cognition.

[15]  Roger N. Shepard,et al.  The Step to Rationality: The Efficacy of Thought Experiments in Science, Ethics, and Free Will , 2008, Cogn. Sci..

[16]  Vincent G. Berthiaume,et al.  A constructivist connectionist model of transitions on false-belief tasks , 2013, Cognition.

[17]  S. Sjogaard Generalization in cascade-correlation networks , 1992, Neural Networks for Signal Processing II Proceedings of the 1992 IEEE Workshop.

[18]  Robert V. Hogg,et al.  Introduction to Mathematical Statistics. , 1966 .

[19]  Jonathan Evans Thinking Twice: Two minds in one brain , 2010 .

[20]  A. Newell Unified Theories of Cognition , 1990 .

[21]  Jacques A. Hagenaars,et al.  Categorical Longitudinal Data. , 1991 .

[22]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[23]  Thomas R. Shultz,et al.  A systematic comparison of flat and standard cascade-correlation using a student–teacher network approximation task , 2007, Connect. Sci..

[24]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[25]  Han L. J. van der Maas,et al.  Towards better computational models of the balance scale task: A reply to Shultz and Takane , 2007, Cognition.

[26]  Herbert Hoijtink,et al.  Rules in the balance: Classes, strategies, or rules for the Balance Scale Task? , 2001 .

[27]  T. Shultz,et al.  Neural network modeling of developmental effects in discrimination shifts. , 1998, Journal of experimental child psychology.

[28]  Thomas R. Shultz,et al.  Neural Network Simulation of Infant Familiarization to Artificial Sentences: Rule-Like Behavior Without Explicit Rules and Variables. , 2001, Infancy : the official journal of the International Society on Infant Studies.

[29]  Thomas R. Shultz,et al.  Modeling Age Differences in Infant Category Learning. , 2004, Infancy : the official journal of the International Society on Infant Studies.

[30]  Thomas R. Shultz,et al.  A computational analysis of conservation. , 1998 .

[31]  Thomas R. Shultz,et al.  Neural networks discover a near-identity relation to distinguish simple syntactic forms , 2006, Minds and Machines.

[32]  Thomas R. Shultz,et al.  Acquisition of concepts with characteristic and defining features , 2008 .

[33]  Jonathan R. Karr,et al.  A Whole-Cell Computational Model Predicts Phenotype from Genotype , 2012, Cell.

[34]  Thomas R. Shultz,et al.  Knowledge-based cascade-correlation: Using knowledge to speed learning , 2001, Connect. Sci..

[35]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[36]  E. Butterfield,et al.  The classification of children's knowledge: development on the balance-scale and inclined-plane tasks. , 1985, Journal of experimental child psychology.

[37]  M. Reiser,et al.  3. A Goodness-of-Fit Test for the Latent Class Model When Expected Frequencies are Small , 1999 .

[38]  R. Siegler Three aspects of cognitive development , 1976, Cognitive Psychology.

[39]  D. Bartholomew,et al.  A goodness of fit test for sparse 2p contingency tables. , 2002, British Journal of Mathematical & Statistical Psychology.

[40]  T. Shultz,et al.  The learning of first and second person pronouns in English: network models and analysis , 1999, Journal of Child Language.

[41]  R. Sun,et al.  The interaction of the explicit and the implicit in skill learning: a dual-process approach. , 2005, Psychological review.

[42]  James L. McClelland Parallel Distributed Processing: Implications for Cognition and Development , 1988 .

[43]  Thomas R. Shultz,et al.  Development of Children's Seriation: A Connectionist Approach , 1999, Connect. Sci..

[44]  T. Shultz,et al.  The Developmental Course of Distance, Time, and Velocity Concepts:A Generative Connectionist Model , 2000 .

[45]  Jeroen K. Vermunt,et al.  'EM: A general program for the analysis of categorical data 1 , 1997 .

[46]  T. Shultz Computational Developmental Psychology , 2003 .

[47]  Maarten van Someren,et al.  Modeling developmental transitions on the balance scale task , 2003, Cogn. Sci..

[48]  J. Kristeva,et al.  Strangers to Ourselves , 1996, Canadian Theatre Review.

[49]  Robert S Siegler,et al.  Development of rules and strategies: balancing the old and the new. , 2002, Journal of experimental child psychology.

[50]  U. Hahn,et al.  German Inflection: Single Route or Dual Route? , 2000, Cognitive Psychology.

[51]  Vincent G. Berthiaume,et al.  A Computational Developmental Model of the Implicit False Belief Task , 2008 .

[52]  Thomas R. Shultz,et al.  A Compositional Neural-network Solution to Prime-number Testing , 2006 .

[53]  A. McCutcheon,et al.  Latent Class Analysis , 2021, Encyclopedia of Autism Spectrum Disorders.

[54]  Thomas R. Shultz,et al.  Toddlers' transitions on non-verbal false-belief tasks involving a novel location: A constructivist connectionist model , 2010, 2010 IEEE 9th International Conference on Development and Learning.

[55]  P. C. Wason,et al.  Dual processes in reasoning? , 1975, Cognition.

[56]  David E. Rumelhart,et al.  Product Units: A Computationally Powerful and Biologically Plausible Extension to Backpropagation Networks , 1989, Neural Computation.

[57]  T. Wickens Multiway Contingency Tables Analysis for the Social Sciences , 1989 .

[58]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[59]  Thomas R. Shultz,et al.  Modeling cognitive development on balance scale phenomena , 1994, Machine Learning.

[60]  J. Pannekoek,et al.  Bootstrapping Goodness-of-Fit Measures in Categorical Data Analysis , 1996 .

[61]  Murray Aitkin,et al.  Statistical Modelling of Data on Teaching Styles , 1981 .

[62]  Brenda R. J. Jansen,et al.  Statistical Test of the Rule Assessment Methodology by Latent Class Analysis , 1997 .

[63]  R. Siegler Emerging Minds: The Process of Change in Children's Thinking , 1996 .

[64]  P. C. Wason,et al.  Rationalization in a Reasoning Task. , 1976 .

[65]  Thomas R. Shultz,et al.  A constructive neural-network approach to modeling psychological development , 2012 .

[66]  Jonathan Evans In two minds: dual-process accounts of reasoning , 2003, Trends in Cognitive Sciences.

[67]  Thomas R. Shultz,et al.  Modeling Acquisition of a Torque Rule on the Balance-scale Task , 2009 .

[68]  Jonathan Evans The heuristic-analytic theory of reasoning: Extension and evaluation , 2006, Psychonomic bulletin & review.

[69]  Thomas R. Shultz,et al.  Bootstrapping syntax from morpho-phonology , 2010, 2010 IEEE 9th International Conference on Development and Learning.

[70]  K. Stanovich On the distinction between rationality and intelligence: Implications for understanding individual differences in reasoning. , 2012 .

[71]  Valerie A. Thompson,et al.  Intuition, reason, and metacognition , 2011, Cognitive Psychology.

[72]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[73]  Thomas R. Shultz,et al.  Constructive learning in the modeling of psychological development , 2011 .

[74]  B. Muthén,et al.  Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study , 2007 .

[75]  Brenda R. J. Jansen,et al.  The development of children's rule use on the balance scale task. , 2002, Journal of experimental child psychology.

[76]  D. Kahneman,et al.  A model of heuristic judgment , 2005 .

[77]  Pat Langley,et al.  A general theory of discrimination learning , 1987 .

[78]  A. Reber,et al.  Implicit learning: An analysis of the form and structure of a body of tacit knowledge , 1977, Cognition.

[79]  D. Kahneman Thinking, Fast and Slow , 2011 .

[80]  A. Shapiro Towards a unified theory of inequality constrained testing in multivariate analysis , 1988 .

[81]  H. Hoijtink Constrained Latent Class Analysis Using the Gibbs Sampler and Posterior Predictive P-values: Applications to Educational Testing , 1998 .

[82]  Brenda R. J. Jansen,et al.  What response times tell of children's behavior on the balance scale task. , 2003, Journal of experimental child psychology.

[83]  T. Shultz,et al.  Development of Prototype Abstraction and Exemplar Memorization , 2010 .

[84]  Andreas Wichert,et al.  Pictorial reasoning with cell assemblies , 2001, Connect. Sci..

[85]  T. Dijkstra,et al.  On statistical inference with parameter estimates on the boundary of the parameter space , 1992 .

[86]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[87]  Shumeet Baluja,et al.  Reducing Network Depth in the Cascade-Correlation Learning Architecture, , 1994 .

[88]  Frédéric Dandurand,et al.  Automatic detection and quantification of growth spurts , 2010, Behavior research methods.

[89]  A. Shapiro Asymptotic distribution of test statistics in the analysis of moment structures under inequality constraints , 1985 .

[90]  T. Shultz Computational Modeling of Infant Concept Learning: The Developmental Shift from Features to Correlations , 2010 .

[91]  Luke J. Chang,et al.  Multiple Systems in Decision Making , 2008, Annals of the New York Academy of Sciences.

[92]  Thomas R. Shultz,et al.  Could Knowledge-Based Neural Learning be Useful in Developmental Robotics? The Case of Kbcc , 2007, Int. J. Humanoid Robotics.

[93]  James L. McClelland,et al.  A connectionist model of a continuous developmental transition in the balance scale task , 2009, Cognition.

[94]  J. Boom,et al.  Classes in the balance: Latent Class Analysis and the Balance Scale Task , 2007 .

[95]  S. Normandeau,et al.  The balance-scale dilemma: either the subject or the experimenter muddles through. , 1989, The Journal of genetic psychology.

[96]  E. Butterfield,et al.  Are children's rule-assessment classifications invariant across instances of problem types? , 1986, Child development.