THE EFFECT OF BASE RATE SENSITIZATION ON END-USER QUERY PERFORMANCE MODERATED BY CONSCIENTIOUSNESS

End users with extensive experience with an organization’s data can often detect query errors when query results do not correspond to their ex ante expectations. Many end users, for example, newly hired business analysts, however, compose queries on unfamiliar data. Their lack of familiarity means that they may be less able to evaluate the reasonableness of their query results. Although additional query experience will eventually give them the familiarity with the data that they need, in the interim, they may not recognize incorrect results from flawed queries. This paper develops and tests base rate sensitization as a means of enabling end users to improve their query performance. Contrary to the hypotheses, sensitizing end users to base rates, as a means of improving their assessments of the likely correctness of their query results, was not associated with significantly fewer query errors on a consistent basis. In a post hoc analysis, participant conscientiousness was found to moderate query performance. Participants of high conscientiousness that were sensitized to base rates made fewer query errors than those not sensitized. In contrast, base rate-sensitized participants with low conscientiousness made more errors than those not sensitized. In this interaction, high conscientiousness participants were able to take advantage of base rate information while low conscientiousness participants appeared to be hindered by base rate sensitization.

[1]  Y. Trope,et al.  The effects of base rates and individuating information on judgments about another person , 1980 .

[2]  R Rogers,et al.  The Uncritical Acceptance of Risk Assessment in Forensic Practice , 2000, Law and human behavior.

[3]  Marie Christine Roy,et al.  Overcoming Ineffective Mental Representations in Base-Rate Problems , 1996, Inf. Syst. Res..

[4]  Pt Jr Costa Revised NEO Personality Inventory and NEO Five-Factor Inventory , 1992 .

[5]  Kevin Lanning,et al.  Some Reasons for Distinguishing Between “Non-normative Response” and “Irrational Decision” , 1987 .

[6]  Robert W. Zmud,et al.  Inducing Sensitivity to Deception in Order to Improve Decision Making Performance: A Field Study , 2002, MIS Q..

[7]  Donald R. Jones,et al.  The effects of information request ambiguity and construct incongruence on query development , 2001, Decis. Support Syst..

[8]  Gordon B. Davis,et al.  Can Humans Detect Errors in Data? Impact of Base Rates, Incentives, and Goals , 1997, MIS Q..

[9]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[10]  Giri Kumar Tayi,et al.  Enhancing data quality in data warehouse environments , 1999, CACM.

[11]  M. Cunningham,et al.  Integrating base rate data in violence risk assessments at capital sentencing. , 1998, Behavioral sciences & the law.

[12]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[13]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[14]  E. Brunswik Perception and the Representative Design of Psychological Experiments , 1957 .

[15]  Paul E. Johnson,et al.  Detecting deception: adversarial problem solving in a low base-rate world , 2001, Cogn. Sci..

[16]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[17]  R. Scott Tindale,et al.  The influence of the accuracy of individuating information on the use of base rate information in probability judgment , 1988 .

[18]  J. Koehler The base rate fallacy reconsidered: Descriptive, normative, and methodological challenges , 1996, Behavioral and Brain Sciences.