The Effect of Contextual and Personal Factors on the Use of Probabilistic Recommenders in E-Markets

E-markets of the future may extend to real-time, on-line auctions of, for example, real estate or antiques. To operate successfully in real-time e-markets, knowledge-based recommenders may become indispensable. Real-time e- market trading decisions typically take place in dynamic and uncertain environments in which high stakes, time pressure, multiple players, and feedback loops are key characteristics. A 2x2x2 design was used in which risk, time pressure and availability of a probabilistic recommender were manipulated. The effect of the recommender on the confidence and performance of three groups of decision-makers (novices, journeymen and expert) was examined. Finally, deductive logic ability was assessed. 84 participants engaged in a laboratory-based computer simulation of a customized version of Blackjack that approximated a real-world e-market decision environment. Recommender use differed with expertise level. Novices were significantly more confident when the recommender was available and used its advice to avoid decision errors. The recommender did not alter the confidence of journeymen and experts but they used it to avoid errors as contextual factors became more complex. There were significant group differences in recommender use to improve strategic outcomes: recommender use enhanced experts' performance, damaged journeymen's and had little effect on novices'. In addition, deductive logic ability was significantly related to fewer decision errors. These results suggest that, to be effective in dynamic e-market environments, knowledge-based recommenders should be tailored to individual differences, particularly decision-makers' expertise and reasoning ability.

[1]  M. Chi,et al.  The Nature of Expertise , 1988 .

[2]  N. Harvey,et al.  Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility☆☆☆ , 1997 .

[3]  C. Vlek,et al.  Multi-attribute decision support and complexity: An evaluation and process analysis of aided versus unaided decision making , 1992 .

[4]  Josep Lluís de la Rosa i Esteva,et al.  A Taxonomy of Recommender Agents on the Internet , 2003, Artificial Intelligence Review.

[5]  K J Vicente,et al.  Less is (sometimes) more in cognitive engineering: the role of automation technology in improving patient safety , 2003, Quality & safety in health care.

[6]  Yaniv,et al.  Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation. , 2000, Organizational behavior and human decision processes.

[7]  Neil Charness,et al.  The role of deliberate practice in chess expertise , 2005 .

[8]  Ilan Yaniv,et al.  Receiving Other People's Advice: Influence and Benefit , 2004 .

[9]  Soe-Tsyr Yuan,et al.  A recommendation mechanism for contextualized mobile advertising , 2003, Expert Syst. Appl..

[10]  J. Phillips,et al.  Departures From Sensible Play in Computer Blackjack , 2000, The Journal of general psychology.

[11]  Maria Fasli,et al.  On agent technology for e-commerce: trust, security and legal issues , 2007, The Knowledge Engineering Review.

[12]  Izak Benbasat,et al.  Inducing compensatory information processing through decision aids that facilitate effort reduction: an experimental assessment , 2000 .

[13]  H. Arkes,et al.  Factors influencing the use of a decision rule in a probabilistic task , 1986 .

[14]  L M Parsons,et al.  New Evidence for Distinct Right and Left Brain Systems for Deductive versus Probabilistic Reasoning. , 2001, Cerebral cortex.

[15]  Pai-Cheng Chu,et al.  The Joint Effects of Effort and Quality on Decision Strategy Choice with Computerized Decision Aids , 2000, Decis. Sci..

[16]  Brendon Towle,et al.  Knowledge Based Recommender Systems Using Explicit User Models , 2000 .

[17]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[18]  William S. Griscom,et al.  Becoming an expert in the musical domain: It takes more than just practice , 2008 .

[19]  G. Keren,et al.  On the Assessment of Decision Quality: Considerations Regarding Utility, Conflict and Accountability , 2003 .

[20]  Gary Klein,et al.  User perception of expert system advice , 1999, J. Syst. Softw..

[21]  R. Dacey,et al.  Perception of randomness and predicting uncertain events , 2008 .

[22]  Robin Burke,et al.  Knowledge-based recommender systems , 2000 .

[23]  Jonathan Evans,et al.  Rapid responding increases belief bias: Evidence for the dual-process theory of reasoning , 2005 .

[24]  Franklin Dexter,et al.  Operating Room Managerial Decision-Making on the Day of Surgery With and Without Computer Recommendations and Status Displays , 2007, Anesthesia and analgesia.

[25]  S. Grazioli,et al.  Success and failure in expert reasoning , 1992 .

[26]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[27]  Nadine B. Sarter,et al.  Supporting Decision Making and Action Selection under Time Pressure and Uncertainty: The Case of In-Flight Icing , 2001, Hum. Factors.

[28]  Mark Rosenstein,et al.  Recommending and evaluating choices in a virtual community of use , 1995, CHI '95.

[29]  Daniel M. Cable,et al.  AN EMPIRICAL INVESTIGATION OF THE PREDICTORS OF EXECUTIVE CAREER SUCCESS , 1995 .

[30]  J. Gutteling,et al.  Information needs and risk perception as predictors of risk information seeking , 2008 .

[31]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[32]  P. C. Chu,et al.  Does Time Constraint on Users Negate the Efficacy of Decision Support Systems? , 2001, Organizational behavior and human decision processes.

[33]  D. Moore,et al.  Effects of Task Difficulty on Use of Advice , 2007 .

[34]  Berend Wierenga,et al.  Virtual communities: A marketing perspective , 2009, Decis. Support Syst..

[35]  Susan Joslyn,et al.  Evaluating individual differences in response to time-pressure situations. , 1998 .

[36]  D. Detterman,et al.  An extraordinary memory: The case study of a musical prodigy , 2003 .

[37]  L. Macchi,et al.  Thinking : psychological perspectives on reasoning, judgment and decision making , 2005 .

[38]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[39]  Alan J. Rowe,et al.  Beyond expert systems—Reasoning, judgment, and wisdom , 1992 .

[40]  Winston R. Sieck,et al.  The recalcitrance of overconfidence and its contribution to decision aid neglect , 2005 .

[41]  S. Kay On the Nature of Expertise. , 1992 .

[42]  Stacey M. Whitecotton The effects of experience and a decision aid on the slope, scatter, and bias of earnings forecasts , 1996 .

[43]  D. Thomas King,et al.  Mind over Machine. , 1978 .

[44]  Wan-Shiou Yang,et al.  A location-aware recommender system for mobile shopping environments , 2008, Expert Syst. Appl..

[45]  Vicky Arnold,et al.  Explanation provision and use in an intelligent decision aid , 2004, Intell. Syst. Account. Finance Manag..

[46]  Timo Ojala,et al.  Bluetooth and WAP push based location-aware mobile advertising system , 2004, MobiSys '04.