The Utility and Need for Incorporating Noncognitive Skills Into Large-Scale Educational Assessments

Most attention in large-scale assessments on educational progress and outcomes addresses cognitive measures of student proficiency. In part, this focus is due to the assumption that “skills” are cognitive in nature and have a high predictive value in terms of productivity. However, the predictive value of cognitive scores on worker productivity and earnings is more modest than commonly assumed. In fact, attempts to relate cognitive test scores from surveys to economic output, although meritorious, require substantial liberties in the interpretation of data. At the same time, there is considerable evidence that noncognitive attributes of individuals related to school experience are as important as—or even more important than—cognitive attributes in predicting both school outcomes and economic productivity. Noncognitive outcome measurement is more challenging to assess than cognitive because of its highly diverse dimensions and difficulties in sampling performance on these dimensions. This chapter addresses the highly incomplete knowledge base on the potential importance of noncognitive aspects of students and schools, issues of measurement and assessment, and their predictive value on adult outcomes.

[1]  C. Blair,et al.  Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. , 2007, Child development.

[2]  J. Hartigan,et al.  Fairness in Employment Testing: Validity Generalization, Minority Issues, and the General Aptitude Test Battery , 1989 .

[3]  Cyril E. Black,et al.  Becoming Modern: Individual Change in Six Developing Countries , 1976 .

[4]  Sergio Urzua,et al.  Racial Labor Market Gaps: The Role of Abilities and Schooling Choices , 2008 .

[5]  Ó. Marcenaro-Gutierrez,et al.  The value of basic skills in the British labour market. Research report, October 2008 , 2007 .

[6]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[7]  G. Camilli,et al.  Meta-Analysis of the Effects of Early Education Interventions on Cognitive and Social Development , 2010, Teachers College Record: The Voice of Scholarship in Education.

[8]  Bruce A. Weinberg,et al.  Interpersonal Styles and Labor Market Outcomes , 2006, The Journal of Human Resources.

[9]  J. Heckman,et al.  A New Cost-Benefit and Rate of Return Analysis for the Perry Preschool Program: A Summary , 2010 .

[10]  J. Finn,et al.  Small Classes in the Early Grades, Academic Achievement, and Graduating From High School , 2005 .

[11]  D. Schkade,et al.  Sorting in the Labor Market: Do Gregarious Workers Flock to Interactive Jobs? , 2007, SSRN Electronic Journal.

[12]  Nicole M. Fortin,et al.  The Gender Wage Gap among Young Adults in the United States: The Importance of Money versus People , 2008 .

[13]  L. Schweinhart Childhood Programs and Practices in the First Decade of Life: The Challenge of the HighScope Perry Preschool Study , 2010 .

[14]  R. Murnane,et al.  The Growing Importance of Cognitive Skills in Wage Determination , 1995 .

[15]  G. Duncan,et al.  School readiness and later achievement. , 2007, Developmental psychology.

[16]  John H. Tyler,et al.  How important are the cognitive skills of teenagers in predicting subsequent earnings , 2000 .

[17]  A. Diamond,et al.  Preschool Program Improves Cognitive Control , 2007, Science.

[18]  Herbert Gintis,et al.  Education, Technology, and the Characteristics of Worker Productivity , 1971 .

[19]  M. Justman,et al.  Education, Social Cohesion and Economic Growth , 2001 .

[20]  A. Inkeles Social Structure and the Socialization of Competence , 1966 .

[21]  H. Gintis,et al.  The Determinants of Earnings: A Behavioral Approach , 2001 .

[22]  W. Steven Barnett,et al.  Educational effects of the Tools of the Mind curriculum: A randomized trial , 2008 .

[23]  E. Hanushek,et al.  The role of cognitive skills in economic development , 2008 .

[24]  T. Wilder,et al.  Grading Education: Getting Accountability Right , 2008 .

[25]  G. Neuman,et al.  Team effectiveness: beyond skills and cognitive ability. , 1999, The Journal of applied psychology.

[26]  Jill E. Ellingson,et al.  High-stakes testing in employment, credentialing, and higher education. Prospects in a post-affirmative-action world. , 2001, The American psychologist.

[27]  A. Sameroff A unified theory of development: a dialectic integration of nature and nurture. , 2010, Child development.

[28]  A. Reynolds,et al.  Childhood programs and practices in the first decade of life , 2010 .

[29]  Richard J. Murnane,et al.  Do different dimensions of male high school students' skills predict labor market success a decade later? Evidence from the NLSY , 2001 .

[30]  J. Heckman,et al.  Three observations on wages and measured cognitive ability , 2001 .

[31]  Erik Lindqvist,et al.  The Labor Market Returns to Cognitive and Noncognitive Ability: Evidence from the Swedish Enlistment , 2009 .

[32]  James J. Heckman,et al.  Estimating the Technology of Cognitive and Noncognitive Skill Formation , 2010, Econometrica : journal of the Econometric Society.

[33]  Douglas N. Harris,et al.  Would Accountability Based on Teacher Value Added Be Smart Policy? An Examination of the Statistical Properties and Policy Alternatives , 2009, Education Finance and Policy.

[34]  R. Robins,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Personality Predictors of Academic Outcomes: Big Five Correlates of GPA and SAT Scores , 2007 .

[35]  Bud Webb,et al.  A REALITY CHECK , 1997 .

[36]  H. Gintis,et al.  Schooling in capitalist America : educational reform and the contradictions of economic life , 1977 .

[37]  Angela L. Duckworth,et al.  The Economics and Psychology of Personality Traits , 2008, The Journal of Human Resources.

[38]  F. Mosteller The Tennessee study of class size in the early school grades. , 1995, The Future of children.

[39]  B. Weel The Noncognitive Determinants of Labor Market and Behavioral Outcomes: Introduction to the Symposium , 2008 .

[40]  E. Hanushek,et al.  Aggregation and the Estimated Effects of School Resources , 1996 .

[41]  W. Barnett,et al.  Benefits of Early Childhood Interventions Across the World: (Under) Investing in the Very Young , 2010 .

[42]  Martin R. West,et al.  The Non-Cognitive Returns to Class Size , 2008 .

[43]  G. Becker,et al.  Human Capital: A Theoretical and Empirical Analysis with Special Reference to Education, Third Edition , 1993 .

[44]  C. Ruhm,et al.  Does prekindergarten improve school preparation and performance? Economics of Education Review, , . , 2007 .

[45]  Gary S Becker,et al.  Front matter, Human Capital: A Theoretical and Empirical Analysis, with Special Reference to Education , 1965 .

[46]  Allison B. Dymnicki,et al.  The impact of enhancing students' social and emotional learning: a meta-analysis of school-based universal interventions. , 2011, Child development.

[47]  J. M. Digman PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL , 1990 .

[48]  Patrick C. Kyllonen,et al.  Personality, Motivation, and College Readiness: A Prospectus for Assessment and Development , 2014 .

[49]  J. Heckman,et al.  The Importance of Noncognitive Skills: Lessons from the GED Testing Program , 2001 .