SELF-REPORTED EFFORT VERSUS ACTUAL PERFORMANCE IN INFORMATION PROCESSING PARADIGMS

Abstract This study provided data supporting Ericsson and Simon's (1980) conclusion that, within the framework of human information processing, verbal reports can provide a valid and informative source of data. One hundred nine volunteer participants were tested on a battery of microcomputerized tasks. After each task, participants were given a self-report questionnaire concerning perceived difficulty and effort expended. One hundred participants returned and were randomly assigned to either an incentive or a no-incentive condition for retest. As a group, participants in the incentive condition reported expending significantly more effort than did participants who received no incentive. There was a parallel between verbal reports (metacognition) and actual performance on the more difficult task, whereas, for some participants, verbal report data proved to be a more sensitive indicator than performance on less difficult tasks. In each case, verbal data either paralleled or augmented the analysis of perform...

[1]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[2]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[3]  The influence of verbal protocol methods on children's mental computation , 1992 .

[4]  A. Bloch.  Murphy's Law and Other Reasons Why Things Go Wrong , 1978 .

[5]  E. E. Jones,et al.  The actor and the observer: Divergent perceptions of the causes of behavior. , 1972 .

[6]  T. Nettelbeck.  Inspection time and intelligence. , 1987 .

[7]  D. Saccuzzo,et al.  Motivation: cause or confound in information processing/intelligence correlations? , 1994, Acta psychologica.

[8]  Johan Hoogstraten,et al.  A constructive replication of White's alleged refutation of Nisbett and Wilson and of Bem: Limitations on verbal reports of internal events. , 1987 .

[9]  Gerald E. Larson,et al.  Cognitive correlates of general intelligence: Toward a process theory of g , 1989 .

[10]  M I Posner,et al.  Chronometric analysis of classification. , 1967, Psychological review.

[11]  Marvina C. Rich.  Verbal Reports on Mental Processes: Issues of Accuracy and Awareness , 1979 .

[12]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[13]  D. Saccuzzo,et al.  Analysis of Test-Retest Reliability for a Battery of Cognitive Speed Tests , 1987 .

[14]  J. Arthur Woodward,et al.  Individual differences in verbal memory performance: A test of alternative information-processing models , 1982 .

[15]  S. Norris.  Effect of Eliciting Verbal Reports of Thinking on Critical Thinking Test Performance. , 1990 .

[16]  R. Thayer,et al.  Measurement of Activation through Self-Report , 1967, Psychological reports.

[17]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[18]  D. Broadbent,et al.  Implicit and explicit knowledge in the control of complex systems , 1986 .

[19]  A. D. Trice.  Reliability of Students' Self-Reports of Scholastic Aptitude Scores: Data from Juniors and Seniors , 1990 .

[20]  G E Larson,et al.  Cognitive Speed and Performance in Basic Electricity and Electronics (BE&E) School. , 1984 .

[21]  Eliot R. Smith,et al.  Limits on perception of cognitive processes: A reply to Nisbett and Wilson. , 1978 .

[22]  K. A. Ericsson,et al.  Verbal reports on thinking. , 1987 .

[23]  J. Marquer,et al.  Reaction Times in the Study of Strategies in Sentence–Picture Verification: A Reconsideration , 1990 .

[24]  John L. Cotton,et al.  Verbal Reports on Mental Processes , 1980 .

[25]  D. Saccuzzo,et al.  The Effect of Incentives on the Reliability and Validity of Cognitive Speed Tests , 1989 .

[26]  T Nettelbeck,et al.  Inspection Time: An Index for Intelligence? , 1982, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[27]  Peter A. White,et al.  Limitations on verbal reports of internal events: A refutation of Nisbett and Wilson and of Bem. , 1980 .