Judgment in a Social Context: Biases, Shortcomings, and the Logic of Conversation

Publisher Summary The chapter focuses on the contribution of conversational processes to the emergence of biases and shortcomings in human judgment, drawing on research in judgment and decision making, attitude measurement, and questionnaire construction. The chapter discusses the logic of conversation in everyday life and in research settings. One of the key assumptions underlying the conduct of conversation holds that all information contributed by participants is relevant to the goal of the ongoing conversation. The chapter illustrates that the biasing effects of questions are mediated by researchers' violations of conversational norms and respondents' erroneous assumption that the questioner is a cooperative communicator. The chapter discusses the formal features of questionnaire construction, such as the specific numeric values presented as part of a rating scale or the range of response alternatives presented as part of a behavioral frequency question, may strongly influence the obtained responses. Experimental studies on the impact of open- and closed-response formats have consistently demonstrated that open- and closed-response formats, yielding considerable differences in the marginal distribution as well as the ranking of items. Unless there is reason to believe that the questioner did not understand the answer already given, the person asked is likely to interpret the second question as a request for new information. =

[1]  D. Hilton Conversational processes and causal explanation. , 1990 .

[2]  Margaret C. Donaldson,et al.  Conservation accidents , 1975, Cognition.

[3]  F. Strack,et al.  A comparison of response effects in self-administered and telephone surveys , 1987 .

[4]  Leslie F. Clark,et al.  RATING SCALES NUMERIC VALUES MAY CHANGE THE MEANING OF SCALE LABELS , 1991 .

[5]  J. Fodor Psychology and Language. , 1970 .

[6]  C. McCann,et al.  Personal and contextual factors in communication: A review of the 'communication game.' , 1992 .

[7]  Susan R. Fussell,et al.  Understanding friends and strangers: The effects of audience design on message comprehension , 1989 .

[8]  E. Tory Higgins,et al.  Knowledge accessibility and activation: Subjectivity and suffering from unconscious sources. , 1989 .

[9]  Norbert Schwarz,et al.  The informative functions of research procedures: Bias and the logic of conversation. , 1993 .

[10]  John P. Robinson,et al.  Questions and answers in attitude surveys , 1982 .

[11]  M. Orne On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[12]  Howard Schuman Context Effects: State of the Past/State of the Art , 1992 .

[13]  Robert W. Oldendick,et al.  Opinions on Fictitious Issues: The Pressure to Answer Survey Questions , 1986 .

[14]  J. Piaget The Child's Conception of Number , 1953 .

[15]  Stanley B. Woll Role of sentence context in the encoding of trait descriptors. , 1980 .

[16]  Michael Argyle,et al.  The social psychology of everyday life , 1992 .

[17]  W. S. Rholes,et al.  "Saying is believing": Effects of message modification on memory and liking for the person described. , 1978 .

[18]  Daniel M. Wegner,et al.  Where Leading Questions Can Lead: The Power of Conjecture in Social Interaction , 1982 .

[19]  F. Strack,et al.  “Order Effects” in Survey Research: Activation and Information Functions of Preceding Questions , 1992 .

[20]  P. Tetlock,et al.  Accountability: a social magnifier of the dilution effect. , 1989, Journal of personality and social psychology.

[21]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[22]  Jeffrey M. Bradshaw,et al.  Leading questions and memory: Pragmatic constraints , 1980 .

[23]  A. Tversky,et al.  On the study of statistical intuitions , 1982, Cognition.

[24]  Richard Jackson Harris,et al.  Psychology of Pragmatic Implication: Information Processing Between the Lines. , 1978 .

[25]  F. Strack,et al.  Thinking, Judging, and Communicating: A Process Account of Context Effects in Attitude Surveys , 1987 .

[26]  S. Fiske Social cognition and social perception. , 1993, Annual review of psychology.

[27]  Daniel M. Wegner,et al.  Incrimination through innuendo: Can media questions become public answers? , 1981 .

[28]  N. Schwarz Stimmung als Information , 1987 .

[29]  M. Blank,et al.  The potency of context in children's cognition: An illustration through conservation. , 1974 .

[30]  Yaacov Trope,et al.  Problem solving in judgment under uncertainty. , 1987 .

[31]  G. Wells,et al.  Is the Attitude-Attribution Paradigm Suitable for Investigating the Dispositional Bias? , 1988, Personality & social psychology bulletin.

[32]  Norbert Schwarz,et al.  Response Scales: Effects of Category Range on Reported Behavior and Comparative Judgments , 1985 .

[33]  一馬 原岡,et al.  Lindzey, G & Aronson, E., 1985, The Handbook of Social Psychology, 3rd Edition, Vol. II, Random House, New York. , 1986 .

[34]  Norbert Schwarz,et al.  Priming and communication: Social determinants of information use in judgments of life satisfaction , 1988 .

[35]  F. Strack The different routes to social judgments: Experiential versus informational strategies , 1992 .

[36]  E. Suchman,et al.  The American Soldier: Adjustment During Army Life. , 1949 .

[37]  H. H. Clark,et al.  Asking questions and influencing answers. , 1992 .

[38]  J. Dockrell,et al.  Conservation Accidents Revisited , 1980 .

[39]  Jon A. Krosnick,et al.  Conversational conventions, order of information acquisition, and the effect of base rates and individuating information on social judgments. , 1990 .

[40]  Phoebe C. Ellsworth,et al.  The social psychology of eyewitness accuracy: Misleading questions and communicator expertise. , 1987 .

[41]  Norbert Schwarz,et al.  Response scales as frames of reference: The impact of frequency range on diagnostic judgements , 1991 .

[42]  Michael Siegal,et al.  Misleading children: Causal attributions for inconsistency under repeated questioning ☆ , 1988 .

[43]  Michaela Wänke,et al.  Semantic and Pragmatic Aspects of Context Effects in Social and Psychological Research , 1991 .

[44]  D. Kahneman,et al.  Timid choices and bold forecasts: a cognitive perspective on risk taking , 1993 .

[45]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[46]  D. Funder,et al.  Errors and mistakes: evaluating the accuracy of social judgment. , 1987, Psychological bulletin.

[47]  KahnemanDaniel,et al.  Timid Choices and Bold Forecasts , 1993 .

[48]  Arie W. Kruglanski,et al.  The Human Subject in the Psychology Experiment: Fact and Artifact , 1975 .

[49]  G. Menon,et al.  Judgments of Behavioral Frequencies: Memory Search and Retrieval Strategies , 1994 .

[50]  F. Strack,et al.  Context Effects in Attitude Surveys: Applying Cognitive Theory to Social Research , 1991 .

[51]  E. Diener,et al.  Subjective well-being. , 1984, Psychological bulletin.

[52]  R. Rosenthal,et al.  Artifact in behavioral research , 1969 .

[53]  H. H. Clark,et al.  Common ground at the understanding of demonstrative reference , 1983 .

[54]  D. Hilton,et al.  Base Rates, Representativeness, and the Logic of Conversation: The Contextual Relevance of “Irrelevant” Information , 1991 .

[55]  R. Wyer,et al.  Cognitive and affective bases of opinion survey responses. , 1989, Journal of personality and social psychology.

[56]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[57]  N. Schwarz,et al.  Judgments of relationship satisfaction: Inter- and intraindividual comparisons as a function of questionnaire structure , 1988 .

[58]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[59]  D. Hilton A Conversational Model of Causal Explanation , 1991 .

[60]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[61]  Margaret C. Donaldson Conservation: What is the question? , 1982 .

[62]  Norbert Schwarz,et al.  Assimilation and Contrast Effects in Part-Whole Question Sequences: A Conversational Logic Analysis , 1991 .

[63]  P. Light,et al.  THE CONSERVATION TASK AS AN INTERACTIONAL SETTING , 1979 .

[64]  N. Schwarz,et al.  What mediates the impact of response alternatives on frequency reports of mundane behaviors , 1990 .

[65]  Seymour Sudman,et al.  Autobiographical memory and the validity of retrospective reports , 1994 .

[66]  Norbert Schwarz,et al.  The range of response alternatives may determine the meaning of the question: Further evidence on informative functions of response alternatives. , 1988 .

[67]  Norbert Schwarz,et al.  Constructing reality and its alternatives: an inclusion/ exclusion model of assimilation and contrast effects in social judgment , 1992 .

[68]  O. D. Duncan,et al.  QUESTIONS ABOUT ATTITUDE SURVEY QUESTIONS , 1973 .

[69]  Norbert Schwarz,et al.  What Response Scales may Tell your Respondents: Informative Functions of Response Alternatives , 1987 .

[70]  J. Piaget,et al.  The Child's Conception of Number , 1953 .

[71]  H. H. Clark,et al.  What's new? Acquiring New information as a process in comprehension , 1974 .

[72]  Deborah H. Gruenfeld,et al.  Semantics and pragmatics of social influence: how affirmations and denials affect beliefs in referent propositions. , 1992, Journal of personality and social psychology.

[73]  What mediates the impact of response alternatives on behavioral reports , 1987 .

[74]  Susan R. Fussell,et al.  The effects of intended audience on message production and comprehension: Reference in a common ground framework , 1989 .

[75]  V B CLINE,et al.  INTERPERSONAL PERCEPTION. , 1964, Progress in experimental personality research.

[76]  Susan R. Fussell,et al.  Perspective-Taking in Communication: Representations of Others' Knowledge in Reference , 1991 .

[77]  S. Presser,et al.  Question Wording as an Independent Variable in Survey Analysis , 1977 .

[78]  D. Hilton,et al.  Knowledge-Based Causal Attribution: The Abnormal Conditions Focus Model , 1986 .

[79]  J. Forgas What is social about social cognition , 1983 .

[80]  Elizabeth F Loftus,et al.  Leading questions and the eyewitness report , 1975, Cognitive Psychology.

[81]  E. Higgins,et al.  The “Communication Game”: Goal-Directed Encoding and Cognitive Consequences , 1982 .

[82]  V. A. Harris,et al.  The Attribution of Attitudes , 1967 .

[83]  T. K. Srull,et al.  Human cognition in its social context. , 1986, Psychological review.

[84]  T. K. Srull,et al.  Handbook of Social Cognition , 1993 .

[85]  P. Converse,et al.  Attitudes and Non-attitudes: Continuation of a Dialogue , 1970 .

[86]  Norbert Schwarz,et al.  Evaluating one's life: A judgment model of subjective well-being. , 1988 .

[87]  Eugene Borgida,et al.  Attribution and the psychology of prediction. , 1975 .

[88]  Cheryl L. Meyer,et al.  The perceived value of constrained behavior: Pressures toward biased inference in the attitude attribution paradigm , 1984 .

[89]  Ellen F. Prince,et al.  Toward a taxonomy of given-new information , 1981 .

[90]  K. H. Stauder,et al.  Psychology of the Child , 1959 .

[91]  L. S. Ross,et al.  The person and the situation , 1991 .

[92]  Robert W. Oldendick,et al.  Pseudo-Opinions on Public Affairs , 1980 .

[93]  Norbert Schwarz,et al.  Short Note Asking Difficult Questions: Task Complexity Increases the Impact of Response Alternatives , 1992 .

[94]  Leonard L. Martin,et al.  Beyond accessibility: The role of processing objectives in judgment , 1992 .

[95]  R. Wyer,et al.  Social cognition and social reality: Information acquisition and use in the laboratory and the real world , 1987 .

[96]  L. Ross The Intuitive Psychologist And His Shortcomings: Distortions in the Attribution Process1 , 1977 .

[97]  L. Rips,et al.  Answering autobiographical questions: the impact of memory and inference on surveys. , 1987, Science.

[98]  R. Nisbett,et al.  The dilution effect: Nondiagnostic information weakens the implications of diagnostic information , 1981, Cognitive Psychology.

[99]  Derek Edwards,et al.  Language and causation : a discursive action model of description and attribution , 1993 .

[100]  Roger Tourangeau,et al.  Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines. , 1987 .

[101]  Norbert Schwarz,et al.  Assessing frequency reports of mundane behaviors: Contributions of cognitive psychology to questionnaire construction. , 1990 .

[102]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .