Potential and efficiency of statistical learning closely intertwined with individuals’ executive functions: a mathematical modeling study

Statistical learning (SL) is essential in enabling humans to extract probabilistic regularities from the world. The ability to accomplish ultimate learning performance with training (i.e., the potential of learning) has been known to be dissociated with performance improvement per amount of learning time (i.e., the efficiency of learning). Here, we quantified the potential and efficiency of SL separately through mathematical modeling and scrutinized how they were affected by various executive functions. Our results showed that a high potential of SL was associated with poor inhibition and good visuo-spatial working memory, whereas high efficiency of SL was closely related to good inhibition and good set-shifting. We unveiled the distinct characteristics of SL in relation to potential and efficiency and their interaction with executive functions.

[1]  Claudia Voelcker-Rehage,et al.  Motor plasticity in a juggling task in older adults-a developmental study. , 2006, Age and ageing.

[2]  F. E. H. N. Wijermans.  The Cambridge Handbook of Computational Psychology , 2009 .

[3]  B. Underwood,et al.  Speed of learning and amount retained: a consideration of methodology. , 1954, Psychological bulletin.

[4]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[5]  R. Seidler,et al.  Working memory capacity correlates with implicit serial reaction time task performance , 2011, Experimental Brain Research.

[6]  Richard P. Heitz,et al.  The speed-accuracy tradeoff: history, physiology, methodology, and behavior , 2014, Front. Neurosci..

[7]  Karen M Rodrigue,et al.  Aging and longitudinal change in perceptual-motor skill acquisition in healthy adults. , 2005, The journals of gerontology. Series B, Psychological sciences and social sciences.

[8]  Sophie Schwartz,et al.  Role of frontal versus temporal cortex in verbal fluency as revealed by voxel-based lesion symptom mapping , 2006, Journal of the International Neuropsychological Society.

[9]  Karolina Janacsek,et al.  Procedural learning in Tourette syndrome, ADHD, and comorbid Tourette-ADHD: Evidence from a probabilistic sequence learning task , 2017, Brain and Cognition.

[10]  S. Segalowitz,et al.  Assessing the development of automaticity in second language word recognition , 1998, Applied Psycholinguistics.

[11]  M. Kendall.  A NEW MEASURE OF RANK CORRELATION , 1938 .

[12]  K. Janacsek,et al.  Boosting human learning by hypnosis. , 2013, Cerebral cortex.

[13]  A. Miyake,et al.  Unity and diversity of executive functions: Individual differences as a window on cognitive structure , 2017, Cortex.

[14]  J. H. Howard,et al.  Age differences in implicit learning of higher order dependencies in serial patterns. , 1997, Psychology and aging.

[15]  G. Marion,et al.  An Introduction to Mathematical Modelling , 2015 .

[16]  R. Singer.  Preperformance state, routines and automaticity: What does it take to realize expertise in self-paced events? , 2001 .

[17]  Dare A. Baldwin,et al.  Segmenting dynamic human action via statistical structure , 2008, Cognition.

[18]  Han L. J. van der Maas,et al.  A Phase Transition Model for the Speed-Accuracy Trade-Off in Response Time Experiments , 2011, Cogn. Sci..

[19]  N. Segalowitz,et al.  Automatic and controlled processes in the first- and second-language reading of fluent bilinguals , 1983, Memory & cognition.

[20]  K. Miller.  Executive functions. , 2005, Pediatric annals.

[21]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[22]  A. Streissguth,et al.  Correlational analyses of procedural and declarative learning performance , 1995 .

[23]  Aaron R. Seitz,et al.  Testing assumptions of statistical learning: Is it long-term and implicit? , 2009, Neuroscience Letters.

[24]  Michaela Swales,et al.  Frontal Lobe Deficits after Head Injury: Unity and Diversity of Function , 1997 .

[25]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[26]  David R. Anderson,et al.  Understanding AIC and BIC in Model Selection , 2004 .

[27]  Arnaud Destrebecqz,et al.  How implicit is visual statistical learning? , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[28]  R. Kessels,et al.  The Corsi Block-Tapping Task: Standardization and Normative Data , 2000, Applied neuropsychology.

[29]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[30]  Arthur L. Benton,et al.  Differential behavioral effects in frontal lobe disease , 1968 .

[31]  William D Gaillard,et al.  Intact implicit learning of spatial context and temporal sequences in childhood autism spectrum disorder. , 2008, Neuropsychology.

[32]  Sara Fripp.  A learning curve. , 2014, Midwives.

[33]  Karolina Janacsek,et al.  Sleep has no critical role in implicit motor sequence learning in young and old adults , 2010, Experimental Brain Research.

[34]  R. Aslin,et al.  Statistical learning in a serial reaction time task: access to separable statistical cues by individual learners. , 2001, Journal of experimental psychology. General.

[35]  Susan M. Ravizza,et al.  Shifting set about task switching: Behavioral and neural evidence for distinct forms of cognitive flexibility , 2008, Neuropsychologia.

[36]  Richard I. Ivry,et al.  Attention and Structure in Sequence Learning , 2004 .

[37]  L. L. Thurstone,et al.  The learning curve equation , 1919 .

[38]  B. Anderson.  Controlled information processing, automaticity, and the burden of proof , 2018, Psychonomic bulletin & review.

[39]  K. Janacsek,et al.  Dynamics of EEG functional connectivity during statistical learning , 2017, Neurobiology of Learning and Memory.

[40]  A. Raftery.  Approximate Bayes factors and accounting for model uncertainty in generalised linear models , 1996 .

[41]  Zarghi Afsaneh,et al.  Assessment of Selective Attention With CSCWT (Computerized Stroop Color-Word Test) Among Children and Adults , 2012 .

[42]  Morten H. Christiansen,et al.  The long road of statistical learning research: past, present and future , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Marc W. Howard,et al.  A Scale-Invariant Internal Representation of Time , 2012, Neural Computation.

[44]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[45]  Caroline F. Rowland,et al.  Visual sequence learning and language development: Evidence for a domain-general learning mechanism? , 2019 .

[46]  M. Kendall.  The treatment of ties in ranking problems. , 1945, Biometrika.

[47]  T. Palmeri.  Exemplar similarity and the development of automaticity. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[48]  I. J. Myung,et al.  Tutorial on maximum likelihood estimation , 2003 .

[49]  R. Gaschler,et al.  Why should working memory be related to incidentally learned sequence structures? , 2015, Cortex.

[50]  D. Stuss,et al.  Is there a dysexecutive syndrome? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[51]  Laura A Baker,et al.  Assessing inattention and impulsivity in children during the Go/NoGo task. , 2009, The British journal of developmental psychology.

[52]  J. de Houwer,et al.  Automaticity: a theoretical and conceptual analysis. , 2006, Psychological bulletin.

[53]  J. Fiser,et al.  The best time to acquire new skills: age-related differences in implicit sequence learning across the human lifespan. , 2012, Developmental science.

[54]  A. Antal,et al.  Right Hemisphere Advantage in Statistical Learning: Evidence From a Probabilistic Sequence Learning Task , 2015, Brain Stimulation.

[55]  A. Osman,et al.  On the locus of speed-accuracy trade-off in reaction time: inferences from the lateralized readiness potential. , 2004, Journal of experimental psychology. General.

[56]  C D Frith,et al.  On the benefits of not trying: brain activity and connectivity reflecting the interactions of explicit and implicit sequence learning. , 2005, Cerebral cortex.

[57]  David S. Glosser,et al.  A Multidimensional Approach , 1993 .

[58]  Markus Martini,et al.  Working Memory and Its Relation to Deterministic Sequence Learning , 2013, PloS one.

[59]  David R. Shanks,et al.  Attentional load and implicit sequence learning , 2005, Psychological research.

[60]  R. Barkley.  The ecological validity of laboratory and analogue assessment methods of ADHD symptoms , 1991, Journal of abnormal child psychology.

[61]  James L. McClelland.  The Place of Modeling in Cognitive Science , 2009, Top. Cogn. Sci..

[62]  R. Dawis,et al.  A Model for Psychometrically Distinguishing Aptitude From Ability , 1975 .

[63]  D. Holdstock.  Past, present--and future? , 2005, Medicine, conflict, and survival.

[64]  M. Petrides,et al.  Wisconsin Card Sorting Revisited: Distinct Neural Circuits Participating in Different Stages of the Task Identified by Event-Related Functional Magnetic Resonance Imaging , 2001, The Journal of Neuroscience.

[65]  D. Fabó,et al.  Competition between frontal lobe functions and implicit sequence learning: evidence from the long-term effects of alcohol , 2015, Experimental Brain Research.

[66]  Amir Karniel,et al.  The exponential learning equation as a function of successful trials results in sigmoid performance , 2010 .

[67]  Jin H. Yan,et al.  Cognitive aging affects motor performance and learning , 2013, Geriatrics & gerontology international.

[68]  H. Akaike.  A new look at the statistical model identification , 1974 .

[69]  Gijsbert Stoet,et al.  PsyToolkit: A software package for programming psychological experiments using Linux , 2010, Behavior research methods.

[70]  小羽 俊士,et al.  Wisconsin card sorting test , 2013 .

[71]  J. Halperin,et al.  Subtype analysis of commission errors on the continuous performance test in children , 1991 .

[72]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .

[73]  Daniel J. Moran,et al.  Evidence-based educational methods , 2004 .

[74]  F. Gombos,et al.  Deconstructing Procedural Memory: Different Learning Trajectories and Consolidation of Sequence and Statistical Learning , 2018, bioRxiv.

[75]  Y. Rosseel.  Latent Variable Analysis , 2015 .

[76]  H. Robbins,et al.  Strong consistency of least squares estimates in multiple regression. , 1979, Proceedings of the National Academy of Sciences of the United States of America.

[77]  R. Barnard.  Cognition and Second Language Instruction , 2003 .

[78]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[79]  D. A. Grant,et al.  A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. , 1948, Journal of experimental psychology.

[80]  Karolina Janacsek,et al.  Implicit sequence learning and working memory: Correlated or complicated? , 2013, Cortex.

[81]  W. Estes.  Toward a Statistical Theory of Learning. , 1994 .

[82]  Z. Mari,et al.  Intact implicit probabilistic sequence learning in obstructive sleep apnea , 2012, Journal of sleep research.

[83]  E. A. Berg,et al.  A simple objective technique for measuring flexibility in thinking. , 1948, The Journal of general psychology.

[84]  Richard N. Aslin,et al.  The neural correlates of statistical learning in a word segmentation task: An fMRI study , 2013, Brain and Language.

[85]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[86]  Scott D. Brown,et al.  The power law repealed: The case for an exponential law of practice , 2000, Psychonomic bulletin & review.

[87]  Darryl W. Schneider.  Alertness and cognitive control: Interactions in the spatial Stroop task , 2020, Attention, perception & psychophysics.

[88]  Elida V. Laski,et al.  When prior knowledge interferes, inhibitory control matters for learning: The case of numerical magnitude representations. , 2015 .

[89]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[90]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[91]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[92]  Richard N Aslin,et al.  Statistical learning of adjacent and nonadjacent dependencies among nonlinguistic sounds , 2009, Psychonomic bulletin & review.

[93]  Morten H. Christiansen,et al.  Modality-constrained statistical learning of tactile, visual, and auditory sequences. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[94]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[95]  Catherine Jones.  Wisconsin card sorting test , 2013 .

[96]  L. Barker,et al.  The Frontal Lobes and Executive Functioning , 2014 .

[97]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[98]  Simon Farrell,et al.  Computational Modeling of Cognition and Behavior , 2018 .

[99]  David R. Anderson,et al.  Avoiding pitfalls when using information-theoretic methods , 2002 .

[100]  Sidney J. Segalowitz,et al.  Skilled performance, practice, and the differentiation of speed-up from automatization effects: Evidence from second language word recognition , 1993, Applied Psycholinguistics.

[101]  Gergő Orbán,et al.  Measuring and Filtering Reactive Inhibition is Essential for Assessing Serial Decision Making and Learning , 2017, Journal of experimental psychology. General.

[102]  T. Ivanova,et al.  The time course of the motoneurone afterhyperpolarization is related to motor unit twitch speed in human skeletal muscle , 2003, The Journal of physiology.

[103]  Gijsbert Stoet,et al.  PsyToolkit: A Novel Web-Based Method for Running Online Questionnaires and Reaction-Time Experiments , 2017 .

[104]  Darryl W. Schneider.  Alertness and cognitive control: Is there a spatial attention constraint? , 2018, Attention, perception & psychophysics.

[105]  Peter Brugger,et al.  Pervasive influence of semantics in letter and category fluency: A multidimensional approach , 2003, Brain and Language.

[106]  M. Pawlak,et al.  Psycholinguistic and sociolinguistic perspectives on second language learning and teaching : studies in honor of Waldemar Marton , 2013 .

[107]  Guido Van Rossum,et al.  Python Tutorial , 1999 .

[108]  Karolina Janacsek,et al.  The puzzle is complicated: When should working memory be related to implicit sequence learning, and when should it not? (Response to Martini et al.) , 2015, Cortex.

[109]  R. Leach.  The learning curve , 1992 .

[110]  Christopher Ball,et al.  Start Right: The Importance of Early Learning. , 1994 .

[111]  Marc W Howard,et al.  A Simple biophysically plausible model for long time constants in single neurons , 2015, Hippocampus.

[112]  P. Frensch,et al.  Effects of presentation rate and individual differences in short-term memory capacity on an indirect measure of serial learning , 1994, Memory & cognition.

[113]  T Togawa,et al.  Chronodiagnostic acquisition of recovery speed of heart rate under bathing stress. , 1999, Physiological measurement.

[114]  H. Seo,et al.  A reservoir of time constants for memory traces in cortical neurons , 2011, Nature Neuroscience.

[115]  M. Chun,et al.  Selective attention modulates implicit learning , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[116]  D. Howard,et al.  Implicit sequence learning: effects of level of structure, adult age, and extended practice. , 2004, Psychology and aging.

[117]  R. Aslin.  Statistical learning: a powerful mechanism that operates by mere exposure. , 2017, Wiley interdisciplinary reviews. Cognitive science.

[118]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[119]  Nikki Vercauteren,et al.  Introduction to Mathematical Modeling , 2015 .

[120]  Scott P. Johnson,et al.  Visual statistical learning in infancy: evidence for a domain general learning mechanism , 2002, Cognition.

[121]  E. Koechlin,et al.  The Importance of Falsification in Computational Cognitive Modeling , 2017, Trends in Cognitive Sciences.

[122]  S. Gass,et al.  Inhibitory Control, Working Memory and L2 Interaction , 2013 .

[123]  A. Reber.  Implicit learning of artificial grammars , 1967 .