Evaluating customer aid functions of online stores with agent-based models of customer behavior and evolution strategy

With competitive pressure growing in online markets, many Internet stores provide various customer aid functions such as personalized pages to help customers shop more effectively and efficiently. Evaluating such customer aid functions is usually costly because it requires full or partly-working systems and many human testers. In order to address this problem, this research presents a novel approach to evaluating customer aid functions with agent-based models of customer behavior and evolution strategies. Agent-based modeling is used to imitate users' rational behavior at Internet stores with regard to browsing and collecting product information. It is assumed that users evolve their browsing skill and strategy over time, to maximize the efficiency and effectiveness of their shopping, and hence, evolution strategy, an optimization method, is combined with the agent-based model to find the rational behavior of each user. The rational behavior is then used to simulate the virtual shopping of users and to evaluate the performances of target customer aid functions. Several experiments were performed to illustrate the use of the approach, where the personalized recommendation page of a virtual online DVD rental store is evaluated in comparison with more general functions such as listing most popular products or sorting categories. The results show that a personalized page might not always be the best customer aid function for all users compared to the simpler ones.

[1]  Wilbert O. Galitz,et al.  The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques , 1996 .

[2]  Hyung Jun Ahn,et al.  Utilizing Popularity Characteristics for Product Recommendation , 2006, Int. J. Electron. Commer..

[3]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[4]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[5]  Harry Chen,et al.  Intelligent Agents Meet the Semantic Web in Smart Spaces , 2004, IEEE Internet Comput..

[6]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[7]  Petra Schubert,et al.  Extended Web Assessment Method (EWAM): Evaluation of Electronic Commerce Applications from the Customer's Viewpoint , 2002, Int. J. Electron. Commer..

[8]  Massimo Genoese,et al.  Agent-based simulation for the German electricity markets - An analysis of the German spot market prices in the year 2001 , 2006 .

[9]  Xavier Serra,et al.  FOAFing the music: Bridging the semantic gap in music recommendation , 2008, J. Web Semant..

[10]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[11]  Wendy W. Moe,et al.  The Influence of Goal‐Directed and Experiential Activities on Online Flow Experiences , 2003 .

[12]  Alexis Drogoul,et al.  Agent-based interaction analysis of consumer behavior , 2002, AAMAS '02.

[13]  Hyung Jun Ahn,et al.  A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem , 2008, Inf. Sci..

[14]  Su Myeon Kim,et al.  Development of a recommender system based on navigational and behavioral patterns of customers in e-commerce sites , 2005, Expert Syst. Appl..

[15]  Shuk Ying Ho,et al.  Understanding the Impact of Web Personalization on User Information Processing and Decision Outcomes , 2006, MIS Q..

[16]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[17]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[18]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[19]  Roberto Leombruni,et al.  A Common Protocol for Agent-Based Social Simulation , 2006, J. Artif. Soc. Soc. Simul..

[20]  Yu Li,et al.  A hybrid collaborative filtering method for multiple-interests and multiple-content recommendation in E-Commerce , 2005, Expert Syst. Appl..

[21]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[22]  P. Kotler,et al.  Principles of Marketing , 1983 .

[23]  Izak Benbasat,et al.  The Effects of Personalizaion and Familiarity on Trust and Adoption of Recommendation Agents , 2006, MIS Q..

[24]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[25]  R. Marks.  Market Design Using Agent-Based Models , 2006 .

[26]  Mark E. Nissen,et al.  Agent-Based Supply Chain Integration , 2001, Inf. Technol. Manag..

[27]  Mark S. Fox,et al.  Agent based design and simulation of supply chain systems , 1997, Proceedings of IEEE 6th Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[28]  Abhinandan Das,et al.  Google news personalization: scalable online collaborative filtering , 2007, WWW '07.

[29]  Peter S. Fader,et al.  Dynamic Conversion Behavior at E-Commerce Sites , 2004, Manag. Sci..

[30]  Michael Lewis.  The Influence of Loyalty Programs and Short-Term Promotions on Customer Retention , 2004 .

[31]  David M. Pennock,et al.  CROC: A New Evaluation Criterion for Recommender Systems , 2005, Electron. Commer. Res..

[32]  Nancy J. Lightner.  Evaluating e-commerce functionality with a focus on customer service , 2004, CACM.

[33]  Duen-Ren Liu,et al.  A hybrid of sequential rules and collaborative filtering for product recommendation , 2009, Inf. Sci..

[34]  H. Simon,et al.  Theories of Decision-Making in Economics and Behavioural Science , 1966 .

[35]  Marinus J. Plasmeijer,et al.  Gast: Generic Automated Software Testing , 2002, IFL.

[36]  Nicholas R. Jennings,et al.  Agent Theories, Architectures, and Languages: A Survey , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[37]  Avishai Mandelbaum,et al.  Adaptive Behavior of Impatient Customers in Tele-Queues: Theory and Empirical Support , 2002, Manag. Sci..

[38]  Daniel R. Dolk,et al.  Agent-based simulation for computational experimentation: Developing an artificial labor market , 2005, Eur. J. Oper. Res..

[39]  David B. Fogel,et al.  An introduction to simulated evolutionary optimization , 1994, IEEE Trans. Neural Networks.

[40]  Paul Twomey,et al.  Agent‐based modelling of customer behaviour in the telecoms and media markets , 2002 .

[41]  Francesco Ricci,et al.  Feature selection methods for conversational recommender systems , 2005, 2005 IEEE International Conference on e-Technology, e-Commerce and e-Service.

[42]  Uday Kumar Chakraborty,et al.  Genetic and evolutionary computing , 2008, Inf. Sci..

[43]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[44]  BenbasatIzak,et al.  E-commerce product recommendation agents , 2007 .

[45]  Toshiyuki Sueyoshi,et al.  Wholesale Power Price Dynamics Under Transmission Line Limits: A Use of an Agent-Based Intelligent Simulator , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[46]  Rian van der Merwe,et al.  A framework and methodology for evaluating e-commerce Web sites , 2003, Internet Res..

[47]  Long-Sheng Chen,et al.  Developing recommender systems with the consideration of product profitability for sellers , 2008, Inf. Sci..

[48]  Mei Cao,et al.  B2C e-commerce web site quality: an empirical examination , 2005, Ind. Manag. Data Syst..

[49]  Andrew Greasley,et al.  Business Information Systems: Technology, Development and Management for the E-Business , 2002 .

[50]  Björn P. Stahmer,et al.  SimMarket: Multiagent-Based Customer Simulation and Decision Support for Category Management , 2003, MATES.

[51]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[52]  Gregory M. P. O'Hare,et al.  Easishop: Ambient intelligence assists everyday shopping , 2008, Inf. Sci..

[53]  Hyung Jun Ahn,et al.  A flexible agent system for change adaptation in supply chains , 2003, Expert Syst. Appl..

[54]  Wendy W. Moe,et al.  Uncovering Patterns in Cybershopping , 2001 .