Protocol Analysis as a Tool for Behavior Analysis

The study of thinking is made difficult by the fact that many of the relevant stimuli and responses are not apparent. Although the use of verbal reports has a long history in psychology, it is only recently that Ericsson and Simon’s (1993) book on verbal reports explicated the conditions under which such reports may be reliable and valid. We review some studies in behavior analysis and cognitive psychology that have used talk-aloud reporting. We review particular methods for collecting reliable and valid verbal reports using the “talk-aloud” method as well as discuss alternatives to the talk-aloud procedure that are effective under different task conditions, such as the use of reports after completion of very rapid task performances. We specifically caution against the practice of asking subjects to reflect on the causes of their own behavior and the less frequently discussed problems associated with providing inappropriate social stimulation to participants during experimental sessions.

[1]  J. Michael.  Two Kinds of Verbal Behavior Plus a Possible Third , 1985, The Analysis of verbal behavior.

[2]  S. Hayes,et al.  OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR EQUIVALENCE CLASS FORMATION IN LANGUAGE-ABLE AND LANGUAGE-DISABLED CHILDREN , 2005 .

[3]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[4]  Blank-trial probes and introtacts in human discrimination learning , 1971 .

[5]  B. Brehmer.  Hypotheses about relations between scaled variables in the learning of probabilistic inference tasks , 1974 .

[6]  K. Duncker.  A Qualitative (Experimental and Theoretical) Study of Productive Thinking (Solving of Comprehensible Problems) , 1926 .

[7]  B Lowenkron,et al.  Joint control and the generalization of selection-based verbal behavior , 1991, The Analysis of verbal behavior.

[8]  E. Loftus,et al.  Memory distortion and false memory creation. , 1996, The Bulletin of the American Academy of Psychiatry and the Law.

[9]  T S Critchfield,et al.  Verbal self-reports of delayed matching to sample by humans. , 1990, Journal of the experimental analysis of behavior.

[10]  P. F. Delaney,et al.  Memory as Behavior: The Importance of Acquisition and Remembering Strategies , 1998, The Analysis of verbal behavior.

[11]  R. Nelson.  Assessment and Therapeutic Functions of Self-Monitoring , 1977 .

[12]  Steven C. Hayes,et al.  THE CASE OF THE SILENT DOG—VERBAL REPORTS AND THE ANALYSIS OF RULES: A REVIEW OF ERICSSON AND SIMON'S PROTOCOL ANALYSIS: VERBAL REPORTS AS DATA1 , 1986 .

[13]  B. A. Matthews,et al.  An Experimental Analysis of Rule-Governed Behavior , 1989 .

[14]  Robert J. Crutcher,et al.  Improving the encoding of verbal reports by using MPAS: A computer-aided encoding system , 1994 .

[15]  The effect of number of irrelevant stimulus dimensions, verbalization, and sex on learning biconditional classification rules , 1967 .

[16]  E. Wulfert,et al.  Protocol analysis of the correspondence of verbal behavior and equivalence class formation. , 1991, Journal of the experimental analysis of behavior.

[17]  M. Sundberg,et al.  Comparing topography-based verbal behavior with stimulus selection-based verbal behavior , 1990, The Analysis of verbal behavior.

[18]  M. Bruck,et al.  Suggestibility of the child witness: a historical review and synthesis. , 1993, Psychological bulletin.

[19]  Richard Sorabji,et al.  Aristotle on Memory , 1972 .

[20]  Mary E. Ahlum-Heath,et al.  The effect of conscious controlled verbalization cognitive strategy on transfer in problem solving , 1986, Memory & cognition.

[21]  M. D. Storms,et al.  Videotape and the attribution process: reversing actors' and observers' points of view. , 1973, Journal of personality and social psychology.

[22]  Jack L Michael,et al.  Concepts and Principles of Behavior Analysis , 1993 .

[23]  A. Reber,et al.  Implicit learning: An analysis of the form and structure of a body of tacit knowledge , 1977, Cognition.

[24]  STAGES IN CONCEPT FORMATION AND LEVELS OF COGNITIVE FUNCTIONING , 1960 .

[25]  J. Michael,et al.  The Role of Mediating Verbal Behavior in Selection-based Responding , 1997, The Analysis of verbal behavior.

[26]  O R Lindsley.  Is Fluency Free-Operant Response-Response Chaining? , 1996, The Behavior analyst.

[27]  M Sidman,et al.  Reading and auditory-visual equivalences. , 1971, Journal of speech and hearing research.

[28]  K. A. Ericsson,et al.  Long-Term Working Memory as an Alternative to Capacity Models of Working Memory in Everyday Skilled Performance , 1999 .

[29]  E. Loftus,et al.  Eyewitness testimony and memory distortion , 1996 .

[30]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[31]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[32]  D White,et al.  Protocol Analysis and the “Silent Dog” Method of Analyzing the Impact of Self-Generated Rules , 1998, The Analysis of verbal behavior.

[33]  David M. Schweiger,et al.  Is the simultaneous verbal protocol a viable method for studying managerial problem solving and decision making , 1983 .

[34]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[35]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[36]  Larry Wilder,et al.  Overt and covert verbalization in problem solving , 1971 .

[37]  S. Lane,et al.  Verbal self-reports of emergent relations in a stimulus equivalence procedure. , 1996, Journal of the experimental analysis of behavior.

[38]  N. C. Boreham,et al.  A model of efficiency in diagnostic problem solving: implications for the education of diagnosticians , 1986 .

[39]  M. Sidman,et al.  Conditional discrimination vs. matching to sample: an expansion of the testing paradigm. , 1982, Journal of the experimental analysis of behavior.

[40]  E. Loftus,et al.  The Formation of False Memories , 1995 .

[41]  K. A. Ericsson,et al.  Verbal reports on thinking. , 1987 .

[42]  A. D. D. Groot.  Thought and Choice in Chess , 1978 .

[43]  M Perone,et al.  Laboratory Lore and Research Practices in the Experimental Analysis of Human Behavior: Use and Abuse of Subjects’ Verbal Reports , 1988, The Behavior analyst.

[44]  Hunter G. Hoffman,et al.  Misinformation and Memory: The Creation of New Memories , 1989 .

[45]  K. A. Ericsson,et al.  Skill and Working Memory , 1982 .

[46]  G. Hendrix.  A New Clue to Transfer of Training , 1947, The Elementary School Journal.

[47]  R. Gagne,et al.  A study of the effects of verbalization on problem solving. , 1962, Journal of experimental psychology.

[48]  E. Shimoff,et al.  Post-session verbal reports and the experimental analysis of behavior , 1986, The Analysis of verbal behavior.

[49]  Patricia M. Hodges,et al.  A comparison of the effectiveness of graphic symbol and manual sign training with profoundly retarded children , 1984, Applied Psycholinguistics.