Exploiting user experience from online customer reviews for product design

Abstract Understanding user experience (UX) becomes more important in a market-driven design paradigm because it helps designers uncover significant factors, such as user’s preference, usage context, product features, as well as their interrelations. Conventional means, such as questionnaire, survey and self-report with predefined questions and prompts, are used to collect information about users’ experience during various UX studies. However, such data is often limited and restricted by initial setups, and they won’t easily allow designers to identify all critical elements such as user profile, context, related product features, etc. Meanwhile, with widely accessible social media, the volume and velocity of customer-generated data are fast-increasing. While it is generally acknowledged that such data contains important elements in understanding and analyzing UX, extracting them to assist product design remains a challenging issue. In this study, how UX data underlying product design can be isolated and restored from customer online reviews is examined. A faceted conceptual model is proposed to elucidate the crucial factors of UX, which serves as an operational mechanism connecting to product design. A methodology of establishing a UX knowledge base from customer online reviews is then proposed to support UX-centered design activities, which consists of three stages, i.e., UX discovery to extract UX data from a single review, UX data integration to group similar data and UX network formalization to build up the causal dependencies among UX groups. Using a case study on smart mobile phone reviews, examples of UX data discovered are demonstrated and both customers and designers concerned key product features and usage situations are exemplified. This study explores the feasibility to discover valuable UX data as well as their relations automatically for product design and business strategic plan by analyzing a large volume of customer online data.

[1]  W. B. Lee,et al.  A methodology for building a semantically annotated multi-faceted ontology for product family modelling , 2011, Adv. Eng. Informatics.

[2]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[3]  Richard L. Hazlett,et al.  Measuring emotional valence to understand the user's experience of software , 2007, Int. J. Hum. Comput. Stud..

[4]  Paul van Schaik,et al.  Modelling user experience - An agenda for research and practice , 2010, Interact. Comput..

[5]  Ying Liu,et al.  Beyond Opinion Mining - How can Automatic Online Opinion Analysis Help in Product Design? , 2010, WEBIST.

[6]  Shimi Naurin Ahmad,et al.  Analyzing electronic word of mouth: A social commerce construct , 2017, Int. J. Inf. Manag..

[7]  Chen-Fu Chien,et al.  UNISON framework of data-driven innovation for extracting user experience of product design of wearable devices , 2016, Comput. Ind. Eng..

[8]  J. Keziya Rani,et al.  Mining Opinion Features in Customer Reviews. , 2016 .

[9]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[10]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[11]  Peter D. Turney.  Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[12]  Lei Zhang,et al.  Entity discovery and assignment for opinion mining applications , 2009, KDD.

[13]  Alexandre N. Tuch,et al.  Analyzing users' narratives to understand experience with interactive products , 2013, CHI.

[14]  David M. Pennock,et al.  Mining the peanut gallery: opinion extraction and semantic classification of product reviews , 2003, WWW '03.

[15]  Chiuhsiang Joe Lin,et al.  Product attributes and user experience design: how to convey product information through user-centered service , 2015, Journal of Intelligent Manufacturing.

[16]  Wu He,et al.  Improving user experience with case-based reasoning systems using text mining and Web 2.0 , 2013, Expert Syst. Appl..

[17]  Gaetano Cascini,et al.  A framework for user experience, needs and affordances , 2014 .

[18]  Paul Dourish,et al.  How emotion is made and measured , 2007, Int. J. Hum. Comput. Stud..

[19]  Virpi Roto,et al.  UX Curve: A method for evaluating long-term user experience , 2011, Interact. Comput..

[20]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[21]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[22]  B. Palese,et al.  The relative importance of service quality dimensions in E-commerce experiences , 2018, Int. J. Inf. Manag..

[23]  Paul van Schaik,et al.  Attitudes towards user experience (UX) measurement , 2014, Int. J. Hum. Comput. Stud..

[24]  Qiang Yang,et al.  Cross-domain sentiment classification via spectral feature alignment , 2010, WWW '10.

[25]  Peter Willett,et al.  Readings in information retrieval , 1997 .

[26]  Bing Liu,et al.  Lifelong Learning for Sentiment Classification , 2015, ACL.

[27]  Qianli Xu,et al.  Fundamentals of product ecosystem design for user experience , 2011 .

[28]  Lennart E. Nacke,et al.  Contextual influences on mobile player experience - A game user experience model , 2013, Entertain. Comput..

[29]  Marianella Chamorro-Koc,et al.  Human experience and product usability: principles to assist the design of user-product interactions. , 2008, Applied ergonomics.

[30]  Oren Etzioni,et al.  Extracting Product Features and Opinions from Reviews , 2005, HLT.

[31]  Thompson S. H. Teo,et al.  Product attributes and brand equity in the mobile domain: The mediating role of customer experience , 2012, Int. J. Inf. Manag..

[32]  Sarah Diefenbach,et al.  Needs, affect, and interactive products - Facets of user experience , 2010, Interact. Comput..

[33]  Theodore Lim,et al.  Engineering design using game-enhanced CAD: The potential to augment the user experience with game elements , 2013, Comput. Aided Des..

[34]  Heejin Lee,et al.  Effects of user experience on user resistance to change to the voice user interface of an in-vehicle infotainment system: Implications for platform and standards competition , 2016, Int. J. Inf. Manag..

[35]  Byeongki Jeong,et al.  Social media mining for product planning: A product opportunity mining approach based on topic modeling and sentiment analysis , 2017, Int. J. Inf. Manag..

[36]  Xu Sun,et al.  Evaluating user experience of adaptive digital educational games with Activity Theory , 2012, Int. J. Hum. Comput. Stud..

[37]  John Zimmerman,et al.  Measuring the dynamics of remembered experience over time , 2010, Interact. Comput..

[38]  Julie Beth Lovins,et al.  Development of a stemming algorithm , 1968, Mech. Transl. Comput. Linguistics.

[39]  Jian Jin,et al.  Review on Recent Advances in Information Mining From Big Consumer Opinion Data for Product Design , 2018, J. Comput. Inf. Sci. Eng..

[40]  Marc Hassenzahl,et al.  User experience (UX): towards an experiential perspective on product quality , 2008, IHM '08.

[41]  Han Tong Loh,et al.  On macro- and micro-level information in multiple documents and its influence on summarization , 2009, Int. J. Inf. Manag..

[42]  Yibai Li,et al.  Business intelligence in online customer textual reviews: Understanding consumer perceptions and influential factors , 2017, Int. J. Inf. Manag..

[43]  Han Tong Loh,et al.  Corpus Building for Corporate Knowledge Discovery and Management: A Case Study of Manufacturing , 2007, KES.

[44]  Jaehyun Park,et al.  Modeling user experience: A case study on a mobile device , 2013 .

[45]  Jian Jin,et al.  Prioritising engineering characteristics based on customer online reviews for quality function deployment , 2014 .

[46]  Robert M. Losee,et al.  Natural language processing in support of decision-making: phrases and part-of-speech tagging , 2001, Inf. Process. Manag..

[47]  Han Tong Loh,et al.  Gather customer concerns from online product reviews - A text summarization approach , 2009, Expert Syst. Appl..

[48]  Murtaza Haider,et al.  Beyond the hype: Big data concepts, methods, and analytics , 2015, Int. J. Inf. Manag..

[49]  Yue Lu,et al.  Latent aspect rating analysis on review text data: a rating regression approach , 2010, KDD.

[50]  Sourav S. Bhowmick,et al.  Affinity-driven prediction and ranking of products in online product review sites , 2010, CIKM.

[51]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[52]  Eric Brill,et al.  Automatically Acquiring Phrase Structure Using Distributional Analysis , 1992, HLT.