The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids

Decision aids (DA) used in online shopping contexts have been shown to improve users' product choices. Given that previous research (e.g., Byrne & Griffitt, 1973) has demonstrated the positive effects of perceived similarity on an individual's evaluation of others, this study investigates the effects of users' perceived similarity with a DA on their evaluations of that DA. More specifically, we investigate the effect of users' perceptions of the similarity between their own decision process and that followed by the DA to arrive at a recommendation (decision process similarity), as well as the similarity between the recommendations made by the DA and users' initial choices (outcome similarity), on their evaluations of the DA's usefulness and trustworthiness. The results of this study show that perceived process similarity exerts positive and significant effects on users' perceptions of the DA's usefulness and trustworthiness. However, the effects of perceived outcome similarity on trust are completely mediated by perceived process similarity. It is also observed that the level of the user's domain knowledge moderates the effects of perceived decision process similarity on both perceived usefulness and trustworthiness. These results have implications for DA design. It is important that designers consider the process by which users make decisions for themselves and align the DA's decision process with those of the user's, especially for the novice user. The full mediation of the effect of outcome similarity on trust by process similarity highlights how a similar decision process can mitigate some of the negative effects of outcome dissimilarity.

[1]  Youngme Moon,et al.  Don’t Blame the Computer: When Self-Disclosure Moderates the Self-Serving Bias , 2003 .

[2]  Thomas Tellefsen,et al.  Toward a Theory of Business Buyer-Seller Similarity , 2001 .

[3]  Charles J. Kacmar,et al.  Developing and Validating Trust Measures for e-Commerce: An Integrative Typology , 2002, Inf. Syst. Res..

[4]  Dean P. Foster,et al.  Precision and Accuracy of Judgmental Estimation , 1997 .

[5]  C. Nass,et al.  Are Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices , 1997 .

[6]  D. Byrne,et al.  Attraction and similarity of personality characteristics. , 1967, Journal of personality and social psychology.

[7]  J. Greenberg,et al.  Toward an integration of cognitive and motivational perspectives on social inference: A biased hypothesis-testing model , 1987 .

[8]  Robert H. Ashton,et al.  Aggregating Subjective Forecasts: Some Empirical Results , 1985 .

[9]  Jagdip Singh,et al.  Consumer Trust, Value, and Loyalty in Relational Exchanges , 2002 .

[10]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[11]  Vicky Arnold,et al.  Impact of intelligent decision aids on expert and novice decision-makers' judgments , 2004 .

[12]  Peretz Shoval,et al.  Information Filtering: Overview of Issues, Research and Systems , 2001, User Modeling and User-Adapted Interaction.

[13]  M. F. Luce,et al.  Constructive Consumer Choice Processes , 1998 .

[14]  D. Robey,et al.  Foreword: special issue on information systems in developing countries , 2007 .

[15]  M. Brucks The Effects of Product Class Knowledge on Information Search Behavior , 1985 .

[16]  Raanan Lipshitz,et al.  Either a medal or a corporal: the effects of success and failure on the evaluation of decision making and decision makers , 1989 .

[17]  S. Moscovici,et al.  Biased information search in group decision making. , 2000, Journal of Personality and Social Psychology.

[18]  E. H. Witte,et al.  Small group processes and interpersonal relations , 1996 .

[19]  A. Tversky,et al.  Support theory: A nonextensional representation of subjective probability. , 1994 .

[20]  S. Schulz-Hardt,et al.  Confirmation bias in sequential information search after preliminary decisions: an expansion of dissonance theoretical research on selective exposure to information. , 2001, Journal of personality and social psychology.

[21]  D. A. Kenny,et al.  Process Analysis , 1981 .

[22]  Clifford Nass,et al.  Are Computers Gender-Neutral? Gender Stereotypic Responses to Computers , 1997 .

[23]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and Voice Mail Emotion/Adoption Study , 1996, ICIS.

[24]  E. B. Andersen,et al.  Modern factor analysis , 1961 .

[25]  A. Chernev Product Assortment and Individual Decision Processes , 2003, Journal of personality and social psychology.

[26]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[27]  Izak Benbasat,et al.  The Role of Design Characteristics in Shaping Perceptions of Similarity: The Case of Online Shopping Assistants , 2006, J. Assoc. Inf. Syst..

[28]  Izak Benbasat,et al.  Recommendation Agents for Electronic Commerce: Effects of Explanation Facilities on Trusting Beliefs , 2007, J. Manag. Inf. Syst..

[29]  Izak Benbasat,et al.  The Effects of Personalizaion and Familiarity on Trust and Adoption of Recommendation Agents , 2006, MIS Q..

[30]  Clifford Nass,et al.  Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics , 2000, Int. J. Hum. Comput. Stud..

[31]  Eric T. Bradlow,et al.  Agents to the Rescue? , 1999 .

[32]  Izak Benbasat,et al.  The Use and Effects of Knowledge-Based System Explanations: Theoretical Foundations and a Framework for Empirical Evaluation , 1996, Inf. Syst. Res..

[33]  D. J. Hill,et al.  Electronic decision aids: Integration of a consumer perspective , 1994 .

[34]  T. Mitchell,et al.  Effects of outcome knowledge and outcome valence on supervisors' evaluations. , 1981 .

[35]  D. Altman,et al.  Statistics notes: Cronbach's alpha , 1997 .

[36]  Dieter Frey,et al.  Information Seeking Among Individuals and Groups and Possible Consequences for Decision Making in Business and Politics , 2018, Understanding Group Behavior.

[37]  Bernard C. Y. Tan,et al.  A Cross-Cultural Study on Escalation of Commitment Behavior in Software Projects , 2000, MIS Q..

[38]  Vicky Arnold,et al.  Explanation provision and use in an intelligent decision aid , 2004, Intell. Syst. Account. Finance Manag..

[39]  J. Pandey,et al.  Dependency similarity, attraction and perceived helpfulness , 1978 .

[40]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[41]  Barton A. Weitz,et al.  Marketing the Unfamiliar: The Role of Context and Item-Specific Information in Electronic Agent Recommendations , 2002 .

[42]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[43]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[44]  C. Berger,et al.  SOME EXPLORATIONS IN INITIAL INTERACTION AND BEYOND: TOWARD A DEVELOPMENTAL THEORY OF INTERPERSONAL COMMUNICATION , 1975 .

[45]  R. Cross,et al.  Why Should I Trust You? Predictors of Interpersonal Trust in a Knowledge Transfer Context , 2002 .

[46]  Izak Benbasat,et al.  Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice , 1999, MIS Q..

[47]  Izak Benbasat,et al.  The Use of Explanations in Knowledge-Based Systems: Cognitive Perspective and a Process-Tracing Analysis , 2000, J. Manag. Inf. Syst..

[48]  Richard Blackburn,et al.  Citation analysis in the organizational sciences. , 1981 .

[49]  Rashmi R. Sinha,et al.  Comparing Recommendations Made by Online Systems and Friends , 2001, DELOS.

[50]  Maryon King,et al.  The effects of expertise, end goal, and product type on adoption of preference formation strategy , 1994 .

[51]  O. Svenson Process descriptions of decision making. , 1979 .

[52]  Izak Benbasat,et al.  Research Report: Empirical Test of an EDI Adoption Model , 2001, Inf. Syst. Res..

[53]  S. Duck,et al.  Personality similarity and friendship choice: similarity of what, when? , 1973, Journal of personality.

[54]  G. Sundström Information search and decision making: The effects of information displays , 1987 .

[55]  Valerie J. Trifts,et al.  Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids , 2000 .

[56]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[57]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[58]  Rebecca A. Henry,et al.  Accuracy and confidence in group judgment , 1989 .

[59]  J. Brockner,et al.  An integrative framework for explaining reactions to decisions: interactive effects of outcomes and procedures. , 1996, Psychological bulletin.

[60]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[61]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[62]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[63]  Izak Benbasat,et al.  Trust In and Adoption of Online Recommendation Agents , 2005, J. Assoc. Inf. Syst..

[64]  Mark A. Fuller,et al.  Involvement and Decision-Making Performance with a Decision Aid: The Influence of Social Multimedia, Gender, and Playfulness , 2005, J. Manag. Inf. Syst..

[65]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[66]  I. Benbasat,et al.  The Influence of Decision Aids on Choice Strategies: An Experimental Analysis of the Role of Cognitive Effort , 1994 .

[67]  C. Nass,et al.  Truth is beauty: researching embodied conversational agents , 2001 .

[68]  J. Baron,et al.  Outcome bias in decision evaluation. , 1988, Journal of personality and social psychology.

[69]  L. Zucker Production of trust: Institutional sources of economic structure, 1840–1920. , 1986 .

[70]  Donald T. Campbell,et al.  Scientific inquiry and the social sciences , 1981 .

[71]  Youngme Moon Intimate Exchanges: Using Computers to Elicit Self-Disclosure from Consumers , 2000 .

[72]  Yaniv,et al.  Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation. , 2000, Organizational behavior and human decision processes.

[73]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[74]  Izak Benbasat,et al.  The Impact of Cognitive Styles on Information System Design , 1978, MIS Q..

[75]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[76]  Jacob Slonim,et al.  An architecture in support of universal access to electronic commerce , 2002, Inf. Softw. Technol..

[77]  B. J. Fogg,et al.  Can computer personalities be human personalities? , 1995, Int. J. Hum. Comput. Stud..

[78]  Ben Salem,et al.  Designing a non-verbal language for expressive avatars , 2000, CVE '00.

[79]  Izak Benbasat,et al.  The Role of Similarity in e-Commerce Interactions: The Case of Online Shopping Assistants , 2005 .