Episodic organization in discourse and valid measurement in the sciences*

Abstract The argument here concerns the episodic organization of discourse and measurement in the sciences. It is developed in two parts. First, empirical effects of episodic organization in discourse processing are demonstrated. The impact on first and second language users is shown by demonstrating loss in comprehension when episodic organization is disrupted. Empirical evidence is also summarized showing that the depth of comprehension of episodic organization is sensitive to relatively minute elements of surface form such as the names of persons and places in the discourse. It can be inferred that the ecological validity of language tests and measures of discourse processing in general is enhanced by respecting episodic organization and reduced by disrupting it. The second part of the argument concerns the deeper question of why episodic organization enhances the ecological validity of language tests and discourse processing measurements in general. Looking into this question from the point of view of Peircean logic, we are led to a surprisingly general inference: that valid measurements of any kind depend on the episodic organization of ordinary experience.

[1]  Richard C. Anderson,et al.  A Schema-Theoretic View of Basic Processes in Reading Comprehension. Technical Report No. 306. , 1988 .

[2]  M. Dryer.  On the Six-Way Word Order Typology , 1997 .

[3]  Michael F. Graves,et al.  Effects of Previewing and Providing Background Knowledge on Taiwanese College Students' Comprehension of American Short Stories , 1995 .

[4]  Joseph H. Greenberg,et al.  Language in the Americas , 1987 .

[5]  Nils Erik Enkvist,et al.  Experiential iconicism in text strategy , 1981 .

[6]  Lourdes Varela,et al.  Some Philosophical Aspects of Pike's Theory of Language in Relation to a Unified Theory of the Structure of Human Behavior , 1971 .

[7]  L. Cronbach,et al.  THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY† , 1963 .

[8]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data , 1992 .

[9]  Yuen Ren Chao,et al.  Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology , 1950 .

[10]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[11]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data , 1991 .

[12]  Rolf A. Zwaan.  Processing Narrative Time Shifts , 1996 .

[13]  John W. Oller,et al.  Background and culture as factors in EFL reading comprehension , 1989 .

[14]  Marta Kutas,et al.  When temporal terms belie conceptual order , 1998, Nature.

[15]  D. Borsboom,et al.  The concept of validity. , 2004, Psychological review.

[16]  S. S. Steivens.  Measurement, Statistics, and the Schemapiric View , 1968 .

[17]  J. Oller,et al.  WHEN ARE CLOZE ITEMS SENSITIVE TO CONSTRAINTS ACROSS SENTENCES , 1977 .

[18]  Paul Robert Hanna,et al.  in the Americas , 1972 .

[19]  John W. Oller,et al.  HOW GRAMMATICAL RELATIONS ARE DETERMINED , 1995 .

[20]  J. W. Oller,et al.  Empirical Predictions From a General Theory of Signs , 2005 .

[21]  J. Charles Alderson,et al.  Sequencing as an item type , 2000 .

[22]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[23]  Chun Chung Lin.  The structures of English and Chinese narratives written by college students in Taiwan , 1989 .

[24]  Patricia L. Carrell,et al.  Interactive Approaches to Second Language Reading: Some causes of text-boundedness and schema interference in ESL reading , 1988 .

[25]  J. Oller.  Common Ground between Form and Content: The Pragmatic Solution to the Bootstrapping Problem. , 2005 .

[26]  Rolf A. Zwaan,et al.  Discourse comprehension. , 1997, Annual review of psychology.

[27]  S. Messick.  Test Validity: A Matter of Consequence , 1998 .

[28]  P. Carrell.  Content and Formal Schemata in ESL Reading , 1987 .

[29]  M. Sasaki.  Effects of cultural schemata on students' test-taking processes for cloze tests: a multiple data source approach , 2000 .

[30]  J. Oller,et al.  Cloze and coherence , 1994 .

[31]  Charles Sanders Peirce,et al.  On a New List of Categories , 2006 .

[32]  Nigel O'Brian,et al.  Generalizability Theory I , 2003 .

[33]  William F. Brewer,et al.  Discourse Organization in the Comprehension of Temporal Order in , 1992 .