Improving New Users’ Query Performance: Deterring Premature Stopping of Query Revision with Information for Forming Ex Ante Expectations

As the volume of data in organizational databases grows, organizations are seeking to use this data to improve organizational success. To this end, users are being asked to query these databases to provide information to help answer questions posed by key management personnel. Users who have had extensive experience with an organization’s data can often detect the presence of errors in their queries when query results do not correspond to their ex ante expectations. New users, however, are less familiar with the data they will be querying. Having no, or limited, ex ante expectations for query results, new users may be unaware that the result produced by their query is incorrect. Unwarranted confidence in the correctness of their queries predisposes these users to stop looking for query errors even when their queries still contain errors. This behavior, premature stopping of query revision, prompts investigating whether new users’ query performance would improve if they were not only provided with, but used, readily available information to form ex ante expectations. Our results demonstrated a threshold effect in new users heeding information for forming ex ante expectations. That is, the mere availability of information for forming ex ante expectations made no difference in query performance. When admonishing users to heed ex ante information, however, there was an associated increase in the accuracy of their queries. These results suggest that users unfamiliar with a particular database might make fewer query errors if they not only received readily available information but were then prompted to use the information to form ex ante expectations for query results.

[1]  Donald P. Ballou,et al.  A Framework for the Analysis of Error in Conjunctive, Multi‐Criteria, Satisficing Decision Processes* , 1990 .

[2]  Stefan Brass,et al.  Semantic errors in SQL queries: a quite complete list , 2004, Fourth International Conference onQuality Software, 2004. QSIC 2004. Proceedings..

[3]  Robert W. Zmud,et al.  Inducing Sensitivity to Deception in Order to Improve Decision Making Performance: A Field Study , 2002, MIS Q..

[4]  John A. Ricketts,et al.  Powers-of-Ten Information Biases , 1990, MIS Q..

[5]  Gordon B. Davis,et al.  Can Humans Detect Errors in Data? Impact of Base Rates, Incentives, and Goals , 1997, MIS Q..

[6]  Donald R. Jones,et al.  The effects of information request ambiguity and construct incongruence on query development , 2001, Decis. Support Syst..

[7]  John B. Smelcer,et al.  User errors in database query composition , 1995, Int. J. Hum. Comput. Stud..

[8]  Barbara Wixom,et al.  An Empirical Investigation of the Factors Affecting Data Warehousing Success , 2001, MIS Q..

[9]  L. V. Jones,et al.  Decision making in a sequential search task , 1967 .

[10]  Rita Almeida Ribeiro,et al.  Fuzzy query interface for a business database , 2003, Int. J. Hum. Comput. Stud..

[11]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[12]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[13]  G Gigerenzer,et al.  The adaptive toolbox: toward a darwinian rationality. , 2001, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[14]  Barbara G. Tabachnick,et al.  SAS for Windows workbook for Tabachnick and Fidell : using multivariate statistics , 2001 .

[15]  InduShobha N. Chengalur-Smith,et al.  The Impact of Experience and Time on the Use of Data Quality Information in Decision Making , 2003, Inf. Syst. Res..

[16]  Barbara Wixom,et al.  Data Warehousing Supports Corporate Strategy At First American Corporation , 2000, MIS Q..

[17]  Thomas Mehle Hypothesis Generation in an Automobile Malfunction Inference Task. , 1982 .

[18]  Marie Christine Roy,et al.  Overcoming Ineffective Mental Representations in Base-Rate Problems , 1996, Inf. Syst. Res..

[19]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[20]  Amnon Rapoport,et al.  Choice behavior in an optional stopping task , 1970 .

[21]  Giri Kumar Tayi,et al.  Enhancing data quality in data warehouse environments , 1999, CACM.

[22]  Mary C. Hill,et al.  End-User Computing Applications , 2011 .

[23]  Naveed Gilani,et al.  Information search in judgment tasks: A regression model and some preliminary findings , 1982 .

[24]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.