Systematic Observation: Relevance of This Approach in Preschool Executive Function Assessment and Association with Later Academic Skills

Executive functions (EFs) are high-level cognitive processes that allow us to coordinate our actions, thoughts, and emotions, enabling us to perform complex tasks. An increasing number of studies have highlighted the role of EFs in building a solid foundation for subsequent development and learning and shown that EFs are associated with good adjustment and academic skills. The main objective of this study was to analyze whether EF levels in 44 Spanish children in the last year of preschool were associated with levels of literacy and math skills the following year, that is, in the first year of compulsory education. We used a multi-method design, which consisted of systematic observation to observe preschool children during play and selective methodology to assess their reading, writing, and math skills in the first year of compulsory primary education. General linear modeling was used to estimate the percentage of variability in academic skills in the first year of primary school that was explained by preschool EF abilities. The results showed that preschool EF level, together with participants and the instrument used to assess academic skills, explained 99% of the variance of subsequent academic performance. Another objective was to determine whether our findings were generalizable to the reference population. To make this determination, we estimated the optimal sample size for assessing preschool EFs. To do this, we performed a generalizability analysis. The resulting generalizability coefficient showed that our sample of 44 students was sufficient for assessing preschool EFs. Therefore, our results are generalizable to the reference population. Our results are consistent with previous reports that preschool EF abilities may be associated with subsequent literacy and math skills. Early assessment of EFs may therefore contribute to identifying children who are likely to experience later learning difficulties and guide the design of suitable interventions for the optimization of EFs.

[1]  Adele Diamond,et al.  Want to Optimize Executive Functions and Academic Outcomes?: Simple, Just Nourish the Human Spirit. , 2013, Minnesota symposia on child psychology.

[2]  S. M. Carlson Developmentally Sensitive Measures of Executive Function in Preschool Children , 2005, Developmental neuropsychology.

[3]  Eric Vilain,et al.  The genetics of sex differences in brain and behavior , 2011, Frontiers in Neuroendocrinology.

[4]  Pedro Sánchez-Algarra,et al.  Qualitative/quantitative integration in the inductive observational study of interactive behaviour: impact of recording and coding among predominating perspectives , 2012, Quality & Quantity.

[5]  Romain Martin,et al.  Executive functioning and reading achievement in school: a study of Brazilian children assessed by their teachers as “poor readers” , 2014, Front. Psychol..

[6]  M. Miclea,et al.  Longitudinal and concurrent links between memory span, anxiety symptoms, and subsequent executive functioning in young children , 2014, Front. Psychol..

[7]  Sandra Johnson,et al.  Applying Generalizability Theory using EduG , 2009 .

[8]  S. Howard,et al.  Evaluation of a differentiation model of preschoolers’ executive functions , 2015, Front. Psychol..

[9]  T. Katzir,et al.  Teachers’ Beliefs and Practices Regarding the Role of Executive Functions in Reading and Arithmetic , 2016, Front. Psychol..

[10]  Salvador Chacón-Moscoso,et al.  Guidelines for reporting evaluations based on observational methodology. , 2015, Psicothema.

[11]  J. Ricarte,et al.  Assessing Executive Functions in Preschoolers Using Shape School Task , 2016, Front. Psychol..

[12]  S. M. Carlson,et al.  Incorporating early development into the measurement of executive function: The need for a continuum of measures across development. , 2016 .

[13]  J. Elliott Multimethod approaches in educational research , 2004 .

[14]  P. Zelazo,et al.  Editorial: Development of Executive Function during Childhood , 2016, Front. Psychol..

[15]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[16]  M. Anguera,et al.  Observation of Interactions in Adolescent Group Therapy: A Mixed Methods Study , 2017, Front. Psychol..

[17]  I. Heuser,et al.  READING and FEELING: the effects of a literature-based intervention designed to increase emotional competence in second and third graders , 2014, Front. Psychol..

[18]  F. Mansouri,et al.  Sex dependency of inhibitory control functions , 2016, Biology of Sex Differences.

[19]  Camilla Gilmore,et al.  Skills underlying mathematics: The role of executive function in the development of mathematics proficiency , 2014, Trends in Neuroscience and Education.

[20]  C. Nelson,et al.  Early experience and brain development. , 2017, Wiley interdisciplinary reviews. Cognitive science.

[21]  K. Espy The Shape School: Assessing executive function in preschool children , 1997 .

[22]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[23]  C. Blair,et al.  School readiness and self-regulation: a developmental psychobiological approach. , 2015, Annual review of psychology.

[24]  A. Diamond,et al.  The relationship between cognition and action: performance of children 3 1 2 –7 years old on a stroop- like day-night test , 1994, Cognition.

[25]  P. Anderson Assessment and Development of Executive Function (EF) During Childhood , 2002, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[26]  Sherri L. Horner,et al.  Performance-based tests versus behavioral ratings in the assessment of executive functioning in preschoolers: associations with ADHD symptoms and reading achievement , 2015, Front. Psychol..

[27]  J. Castejón,et al.  Differences in Learning Strategies, Goal Orientations, and Self-Concept between Overachieving, Normal-Achieving, and Underachieving Secondary Students , 2016, Front. Psychol..

[28]  Katrin Baumgartner Sas System For Elementary Statistical Analysis , 2016 .

[29]  S. Graham,et al.  Primary Grade Writing Instruction: A National Survey. , 2008 .

[30]  E. A. Strommen Verbal self-regulation in a children's game: Impulsive errors on "Simon says." , 1973 .

[31]  Sonja Veličković PROBLEMS DISCONTINUITY ON THE FIRST LEVEL OF THE SCHOOL SYSTEM , 2013 .

[32]  Stefano Vicari,et al.  Executive functions in developmental dyslexia , 2014, Front. Hum. Neurosci..

[33]  Carmen Rosa Sánchez López,et al.  Aplicación de la TG en el deporte para el estudio de la fiabilidad, validez y estimación de la muestra , 2014 .

[34]  M. Eid,et al.  What makes a thriver? Unifying the concepts of posttraumatic and postecstatic growth , 2015, Front. Psychol..

[35]  A. Miyake,et al.  The relations among inhibition and interference control functions: a latent-variable analysis. , 2004, Journal of experimental psychology. General.

[36]  Peter J. Anderson,et al.  Assessing Executive Function in Preschoolers , 2012, Neuropsychology Review.

[37]  M. Anguera,et al.  Goal Scoring in Soccer: A Polar Coordinate Analysis of Motor Skills Used by Lionel Messi , 2016, Front. Psychol..

[38]  A. Seabra,et al.  Age Differences in Executive Functions within a Sample of Brazilian Children and Adolescents , 2013, The Spanish Journal of Psychology.

[39]  Sarah Mae Sincero,et al.  Ecological systems theory , 2020, Zbornik radova Filozofskog fakulteta u Splitu.

[40]  C. Shaw,et al.  Guidelines for research with children and young people , 2011 .

[41]  L. Harper Supporting Young Children’s Transitions to School: Recommendations for Families , 2016 .

[42]  J. Garcia-Madruga,et al.  Executive Functions and the Improvement of Thinking Abilities: The Intervention in Reading Comprehension , 2016, Front. Psychol..

[43]  Sheng Zhang,et al.  Gender Differences in Cognitive Control: an Extended Investigation of the Stop Signal Task , 2009, Brain Imaging and Behavior.

[44]  Sandra A Wiebe,et al.  Longitudinal associations between executive control and developing mathematical competence in preschool boys and girls. , 2013, Child development.

[45]  David J. Purpura,et al.  Foundations of mathematics and literacy: The role of executive functioning components. , 2017, Journal of experimental child psychology.

[46]  Henry L. Roediger,et al.  Research Methods in Psychology , 1985 .

[47]  Oleguer Camerino,et al.  Lince: Multiplatform Sport Analysis Software , 2012 .

[48]  S. Brinkmann Perils and Potentials in Qualitative Psychology , 2015, Integrative psychological & behavioral science.

[49]  S. Federici,et al.  Models of Disability in Children’s Pretend Play: Measurement of Cognitive Representations and Affective Expression Using the Affect in Play Scale , 2017, Front. Psychol..

[50]  Alan C. Acock,et al.  Predictors of early growth in academic achievement: the head-toes-knees-shoulders task , 2014, Front. Psychol..

[51]  F. Wertz,et al.  Qualitative Inquiry in the History of Psychology , 2014 .

[52]  K. Miller Executive functions. , 2005, Pediatric annals.

[53]  R. Bakeman,et al.  Sequential analysis and observational methods for the behavioral sciences , 2011 .

[54]  Maria Carmen Usai,et al.  Improving executive function in childhood: evaluation of a training intervention for 5-year-old children , 2015, Front. Psychol..

[55]  J. Castejón,et al.  Estimation of the Proportion of Underachieving Students in Compulsory Secondary Education in Spain: An Application of the Rasch Model , 2016, Front. Psychol..

[56]  Valentina De Franchis,et al.  How preschool executive functioning predicts several aspects of math achievement in Grades 1 and 3: A longitudinal study. , 2015, Journal of experimental child psychology.

[57]  M. Willoughby,et al.  Measuring executive function in early childhood: A case for formative measurement. , 2016, Psychological assessment.

[58]  Pascale Colé,et al.  Cognitive flexibility predicts early reading skills , 2014, Front. Psychol..

[59]  Stephanie Bennett,et al.  Find the Hidden Object. Understanding Play in Psychological Assessments , 2017, Front. Psychol..

[60]  K. Magnuson,et al.  Investing in Preschool Programs , 2013, The journal of economic perspectives : a journal of the American Economic Association.

[61]  T. Jay,et al.  Understanding and supporting block play: Video observation research on preschoolers’ block play to identify features associated with the development of abstract thinking , 2017 .

[62]  Hongying Zheng Teachers’ beliefs and practices , 2014 .

[63]  M. Greenberg,et al.  The measurement of executive function at age 5: psychometric properties and relationship to academic achievement. , 2012, Psychological assessment.