Automatic measurement of propositional idea density from part-of-speech tagging

The Computerized Propositional Idea Density Rater (CPIDR, pronounced “spider”) is a computer program that determines the propositional idea density (P-density) of an English text automatically on the basis of partof-speech tags. The key idea is that propositions correspond roughly to verbs, adjectives, adverbs, prepositions, and conjunctions. After tagging the parts of speech using MontyLingua (Liu, 2004), CPIDR applies numerous rules to adjust the count, such as combining auxiliary verbs with the main verb. A “speech mode” is provided in which CPIDR rejects repetitions and a wider range of fillers. CPIDR is a user-friendly Windows .NET application distributed as open-source freeware under GPL. Tested against human raters, it agrees with the consensus of two human raters better than the team of five raters agree with each other [r(80) = .97 vs. r(10) = .82, respectively].

[1]  R D Hill,et al.  Very mild senile dementia of the Alzheimer type. II. Psychometric test performance. , 1989, Archives of neurology.

[2]  Walter Kintsch,et al.  Reading rate and retention as a function of the number of propositions in the base structure of sentences , 1973 .

[3]  Joanna S. Gorin,et al.  Improving Construct Validity with Cognitive Psychology Principles. , 2001 .

[4]  Roy Freedle,et al.  The Prediction of GRE Reading Comprehension Item Difficulty for Expository Prose Passages for Each of Three Item Types: Main Ideas, Inferences and Explicit Statements. GRE Board Professional Report No. 87-10P. , 1991 .

[5]  Beatrice Santorini,et al.  Part-of-Speech Tagging Guidelines for the Penn Treebank Project (3rd Revision) , 1990 .

[6]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .

[7]  Esther Thorson,et al.  Viewer Recall of Television Commercials: Prediction from the Propositional Structure of Commercial Scripts , 1984 .

[8]  David E. Kieras,et al.  A Guide to Propositional Analysis for Research on Technical Prose. , 1981 .

[9]  D. Balota,et al.  Discourse analysis of logical memory recall in normal aging and in dementia of the Alzheimer type. , 2003, Neuropsychology.

[10]  W. Kintsch,et al.  Discourse comprehension : essays in honor of Walter Kintsch , 1996 .

[11]  R. Flesch.  A new readability yardstick. , 1948, The Journal of applied psychology.

[12]  Richard C. Anderson.  How to Construct Achievement Tests to Assess Comprehension , 1972 .

[13]  S. Kemper,et al.  Life-span changes to adults' language: Effects of memory and genre , 1989, Applied Psycholinguistics.

[14]  Hugh L'Etang.  Ailing leaders in power , 1996 .

[15]  S. Kemper,et al.  Longitudinal change in language production: effects of aging and dementia on grammatical complexity and propositional content. , 2001, Psychology and aging.

[16]  Susan Kemper,et al.  The Effects of Aging and Dual Task Demands on Language Production , 2009, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[17]  William A. Prothero,et al.  Applying Argumentation Analysis to Assess the Quality of University Oceanography Students' Scientific Writing , 2002 .

[18]  W. Kintsch,et al.  The representation of meaning in memory , 1974 .

[19]  Michael A. Covington,et al.  Measuring propositional idea density through part-of-speech tagging , 2007 .

[20]  Alexandra J. Fiocco,et al.  Aging and Alzheimer's Disease , 2009 .

[21]  S. Kemper,et al.  The structure of verbal abilities in young and older adults. , 2001, Psychology and aging.

[22]  D. Wechsler.  A Standardized Memory Scale for Clinical Use , 1945 .

[23]  John Olsson.  Forensic Linguistics: An Introduction to Language, Crime and the Law , 2004 .

[24]  Michael A Covington,et al.  Does ketamine mimic aspects of schizophrenic speech? , 2007, Journal of psychopharmacology.

[25]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[26]  S. Satya-Murti.  Ailing Leaders in Power 1914-1994 , 1996 .

[27]  D R Wekstein,et al.  Linguistic ability in early life and cognitive function and Alzheimer's disease in late life. Findings from the Nun Study. , 1996, JAMA.