Chapter 9 : Addressing the “Two Disciplines” Problem: Linking Theories of Cognition and Learning With Assessment and Instructional Practice

On September 2,1957, Lee Cronbach delivered his visionary presidential address to the American Psychological Association (APA), calling for the unification of differential and experimental psychology, the two disciplines of scientific psychology. He described the essential features of each approach to asking questions about human nature, and he strongly hinted at the benefits to be gained by unification. Cronbach was calling for linking theories and research on learning and instruction, especially the instructional treatments that logically and psychologically followed from such research, with the tradition of assessing individual differences in cognitive abilities. In his opinion, such work would probably yield information of profound educational relevance. In describing some illustrative examples, he stated, quite boldly, "Such findings . . . when replicated and explained, will carry us into an educational psychology which measures readiness for different types of teaching and which invents teaching methods to fit different types of readiness" (p. 681). He subsequently went even further and argued that this work had broader theoretical impact and meaning. "Constructs originating in differential psychology are now being tied to experimental variables. As a result, the whole theoretical picture in such an area as human abilities is changing" (p. 682).

[1]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[2]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[3]  Robert J. Sternberg,et al.  Mind in context : interactionist perspectives on human intelligence , 1994 .

[4]  Randall J. Mumaw,et al.  Individual differences in complex spatial processing , 1984 .

[5]  Robert Glaser,et al.  Assessment in Transition: Monitoring the Nation's Educational Progress. , 1997 .

[6]  Corporate The Cognition and Technology Group at Vanderbilt A multimedia literacy series: the cognition and technology group at Vanderbilt , 1996, CACM.

[7]  Nambury S. Raju,et al.  Grading the nation's report card : research from the evaluation of NAEP , 2000 .

[8]  David F. Lohman,et al.  Component scores as residual variation (or why the intercept correlates best) , 1994 .

[9]  Ann L. Brown Learning, remembering, and understanding , 1982 .

[10]  C. Perfetti,et al.  Relationship Between Single Word Decoding and Reading Comprehension Skill , 1975 .

[11]  Eva L. Baker,et al.  Testing and Cognition , 1991 .

[12]  S. Messick The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[13]  Ning Wang,et al.  Validating the cognitive complexity and content quality of a mathematics performance assessment , 1994 .

[14]  L. Cronbach Beyond the Two Disciplines of Scientific Psychology. , 1975 .

[15]  Robert J. Mislevy,et al.  PROBABILITY‐BASED INFERENCE IN COGNITIVE DIAGNOSIS , 1994 .

[16]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[17]  R. Glaser,et al.  Knowledge-based cognition and performance assessment in the science classroom , 1996 .

[18]  R. Shavelson Performance Assessments: Political Rhetoric and Measurement Reality , 1992 .

[19]  G. H. Fischer,et al.  The linear logistic test model as an instrument in educational research , 1973 .

[20]  Paul D. Nichols,et al.  A Framework for Developing Cognitively Diagnostic Assessments , 1994 .

[21]  John D. Bransford,et al.  The Jasper Project: Lessons in Curriculum, Instruction, Assessment, and Professional Development , 1997 .

[22]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[23]  E. Hunt,et al.  Individual Differences in Cognition: A New Approach to Intelligence , 1973 .

[24]  Dan J. Woltz,et al.  An investigation of the role of working memory in procedural skill acquisition. , 1988 .

[25]  L. Cronbach The two disciplines of scientific psychology. , 1957 .

[26]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .

[27]  James W. Pellegrino,et al.  Cognitive correlates and components in the analysis of individual differences , 1979 .

[28]  L. Cronbach,et al.  Psychological tests and personnel decisions , 1958 .

[29]  R. Glaser,et al.  The Future of Testing: A Research Agenda for Cognitive Psychology and Psychometrics. , 1981 .

[30]  P. Ackerman Individual differences in information processing: An investigation of intellectual abilities and task performance during practice ☆ , 1986 .

[31]  R. Sternberg Intelligence, Information Processing and Analogical Reasoning : The Componential Analysis of Human Abilities , 1977 .

[32]  M. Scardamalia,et al.  The psychology of written composition , 1987 .

[33]  Ela Hunt,et al.  A cognitive approach to the teaching of physics , 1994 .

[34]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[35]  S. Embretson A general latent trait model for response processes , 1984 .

[36]  C. Hirsch Curriculum and Evaluation Standards for School Mathematics , 1988 .

[37]  Wm. R. Wright General Intelligence, Objectively Determined and Measured. , 1905 .

[38]  J. B. Wyman,et al.  What is reading ability , 1921 .

[39]  S. Embretson Test design : developments in psychology and psychometrics , 1985 .

[40]  John B. Carroll,et al.  PSYCHOMETRIC TESTS AS COGNITIVE TASKS: A NEW "STRUCTURE OF INTELLECT" , 1974 .

[41]  Daniel L. Schwartz,et al.  Doing with Understanding: Lessons from Research on Problem- and Project-Based Learning , 1998 .

[42]  James W. Pellegrino,et al.  Analyzing Aptitudes for Learning: Inductive Reasoning. , 1984 .

[43]  C. Harris Problems in measuring change , 1965 .

[44]  Edward A. Silver,et al.  The Quasar Project , 1996 .

[45]  R. Stiggins Student-centered classroom assessment , 1994 .

[46]  Anthony J. Nitko,et al.  Designing tests that are integrated with instruction. , 1989 .

[47]  Raymond S. Nickerson,et al.  New Directions in Educational Assessment , 1989 .

[48]  A. Anastasi Psychology, psychologists, and psychological testing. , 1967, The American psychologist.

[49]  John B. Willett,et al.  Using covariance structure analysis to detect correlates and predictors of individual change over time , 1994 .

[50]  Richard E. Snow,et al.  Cognitive-conative aptitude interactions in learning. , 1989 .

[51]  L. Resnick,et al.  Assessing the Thinking Curriculum: New Tools for Educational Reform , 1992 .

[52]  R. Duschl,et al.  Strategies and Challenges to Changing the Focus of Assessment and Instruction in Science Classrooms. , 1997 .

[53]  R. Linn Educational Testing and Assessment: Research Needs and Policy Issues. , 1986 .

[54]  K. Tatsuoka RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[55]  E. Hunt Mechanics of Verbal Ability. , 1978 .

[56]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[57]  Robert Glaser,et al.  Investigating the Cognitive Complexity of Science Assessments , 1998 .

[58]  M. Chi,et al.  The Nature of Expertise , 1988 .

[59]  F. Lord A theory of test scores. , 1952 .

[60]  Stephen B. Dunbar,et al.  Quality Control in the Development and Use of Performance Assessments , 1991 .

[61]  J. Shea National Science Education Standards , 1995 .

[62]  Leonard S. Cahen,et al.  Educational Testing Service , 1970 .

[63]  James W. Pellegrino,et al.  Grading the Nation's Report Card: Evaluating NAEP and Transforming the Assessment of Educational Progress. , 1999 .

[64]  M. Scardamalia,et al.  Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise , 1993 .

[65]  T. M. Tomlinson,et al.  A Nation At Risk , 1987 .

[66]  A. D. D. Groot Thought and Choice in Chess , 1978 .

[67]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[68]  Edward Haertel,et al.  An Application of Latent Class Models to Assessment Data , 1984 .

[69]  Vimla L. Patel,et al.  Knowledge Based Solution Strategies in Medical Reasoning , 1986, Cogn. Sci..

[70]  J. M. Cattell Aptitude and Achievement , 1926, Nature.

[71]  H. Simon,et al.  Perception in chess , 1973 .

[72]  Earl Hunt,et al.  The DIAGNOSER: A HyperCard tool for building theoretically based tutorials , 1991 .

[73]  D. Jackson,et al.  Individual differences in affective and conative functions. , 1996 .

[74]  V. Shute,et al.  Individual Difference in Repetition Priming and Its Relationship to Declarative Knowledge Acquisition. , 1993 .

[75]  James W. Pellegrino,et al.  Comparing the Tortoise and the Hare: Gender Differences and Experience in Dynamic Spatial Reasoning Tasks , 1993 .

[76]  Susan R. Goldman,et al.  Evaluation of Procedure-Based Scoring for Hands-On Science Assessment , 1992 .

[77]  R. Shavelson,et al.  Sampling Variability of Performance Assessments. , 1993 .

[78]  R. Glaser Components of a Psychology of Instruction: Toward a Science of Design , 1976 .

[79]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[80]  C. Spearman,et al.  Demonstration of Formulae for True Measurement of Correlation , 1907 .

[81]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[82]  R. Glaser Advances in Instructional Psychology , 1978 .

[83]  S. Whitely Construct validity: Construct representation versus nomothetic span. , 1983 .

[84]  J. Frederiksen,et al.  Inquiry, Modeling, and Metacognition: Making Science Accessible to All Students , 1998 .

[85]  H. Simon,et al.  Empirical tests of a theory of human acquisition of concepts for sequential patterns , 1973 .

[86]  John Seely Brown,et al.  Diagnostic Models for Procedural Bugs in Basic Mathematical Skills , 1978, Cogn. Sci..

[87]  R. Mislevy Evidence and inference in educational assessment , 1994 .

[88]  Robert J. Mislevy,et al.  FOUNDATIONS OF A NEW TEST THEORY , 1982 .

[89]  R. Sternberg Advances in the psychology of human intelligence , 1982 .

[90]  Patrick C. Kyllonen,et al.  Componential modeling of alternative strategies for performing spatial tasks , 1984 .

[91]  L. Cronbach,et al.  Aptitudes and instructional methods: A handbook for research on interactions , 1977 .

[92]  Susan E. Whitely,et al.  Multicomponent latent trait models for ability tests , 1980 .

[93]  P. Ackerman Individual differences in skill learning: An integration of psychometric and information processing perspectives. , 1987 .

[94]  Susan R. Goldman,et al.  Discourse Memory and Reading Comprehension Skill. , 1976 .

[95]  A. Su,et al.  The National Council of Teachers of Mathematics , 1932, The Mathematical Gazette.

[96]  Ann L. Brown,et al.  Guided, Cooperative Learning and Individual Knowledge Acquisition , 2018, Knowing, Learning, and Instruction.

[97]  E. Michael Nussbaum,et al.  Interview Procedures for Validating Science Assessments , 1997 .

[98]  Leona Schauble,et al.  Innovations in learning : new environments for education , 1996 .

[99]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[100]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[101]  R. Snow,et al.  Implications of cognitive psychology for educational measurement. , 1989 .

[102]  R Wood,et al.  Aptitude and achievement , 1982 .

[103]  R. Shavelson,et al.  Research news and Comment: Performance Assessments , 1992 .

[104]  J. Lagowski National Science Education Standards , 1995 .

[105]  Willem J. M. Levelt,et al.  The child's conception of language , 1978 .

[106]  J. Pellegrino,et al.  Structural modeling of information coordination abilities: An evaluation and extension of the Yee, Hunt, and Pellegrino model , 1994 .

[107]  M. O’Connor,et al.  Changing assessments : alternative views of aptitude, achievement and instruction , 1994 .

[108]  Patrick C. Kyllonen,et al.  Aptitude Testing Inspired by Information Processing: A Test of the Four-Sources Model , 1993 .

[109]  P. Ackerman Determinants of individual differences during skill acquisition: Cognitive abilities and information processing. , 1988 .

[110]  S. Chipman,et al.  Cognitively diagnostic assessment , 1995 .

[111]  Susan R. Goldman,et al.  Learning from text: Reflections on the past and suggestions for the future , 1997 .

[112]  R. Linn Educational measurement, 3rd ed. , 1989 .

[113]  Ian Westbury A Nation at Risk , 1984 .

[114]  N. Frederiksen The real test bias: Influences of testing on teaching and learning. , 1984 .

[115]  James W. Pellegrino,et al.  Training effects and working memory contributions to skill acquisition in a complex coordination task , 1995 .

[116]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[117]  L. Darling-Hammond Performance-Based Assessment and Educational Equity , 1994 .

[118]  Carolyn N. Hedley,et al.  Thinking and literacy : the mind at work , 1995 .

[119]  K. McGilly,et al.  Classroom lessons: Integrating cognitive theory and classroom practice. , 1994 .

[120]  John B. Willett,et al.  Questions and Answers in the Measurement of Change , 1988 .

[121]  Susan R. Goldman,et al.  Students making sense of informational text: Relations between processing and representation , 1998 .

[122]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[123]  Susan E. Embretson,et al.  A multidimensional latent trait model for measuring learning and change , 1991 .

[124]  J. Carroll How shall we study individual differences in cognitive abilities?—Methodological and theoretical perspectives☆ , 1978 .

[125]  J. Starkes,et al.  Perception in Sport: Volleyball , 1980 .

[126]  Los Angeles,et al.  on Evaluation, Standards, and Student Testing, , 1991 .

[127]  Mark Wilson Saltus: A psychometric model of discontinuity in cognitive development. , 1989 .

[128]  Lee J. Cronbach,et al.  Psychological tests and personnel decisions , 1958 .

[129]  Valerie J. Shute,et al.  Taxonomy of Learning Skills , 1988 .

[130]  Robert J. Mislevy,et al.  Test Theory for A New Generation of Tests , 1994 .

[131]  R. Bruning Cognitive Psychology and Instruction , 1998 .

[132]  Joe L. Lewis,et al.  What does it mean to be high verbal? , 1975, Cognitive Psychology.