Understanding the factors influencing user experience in social question and answer services

Introduction. The popularity of social question and answer sites has made it an important and convenient source for obtaining knowledge. This study quantifies how three different system characteristics (interface design, interaction and answer quality) affect users' perceptions (perceived usefulness, perceived ease of use and perceived enjoyment), which in turn alter the perceived user experience. Method. Using an online survey, this study investigated the experience of using a leading Chinese site, Baidu Knows. The study received 218 validated responses which were used to test the research model. Analysis. Structural equation modelling technique was used to evaluate the hypothesised research framework. Results. The results show that the influences of the system characteristics (interface design, interaction and answer quality) on user experience are well mediated by user perceptions of usefulness, ease of use and enjoyment. Additionally, perceived usefulness and perceived enjoyment have direct and significant influences on user experience. Against expectations, perceived ease of use is found to have no significant direct effect on user experience, but have an indirect effect mediated through perceived usefulness. Conclusion. Use experience is mainly determined by user perceptions about its usefulness,the ease of use and the enjoyment of using the social question and answer sites, which are derived from their evaluation in relation to specific service features. By identifying these service features and quantifying how they affect user experience, a number of practical suggestions for service design have been made to help social question and answer sites managers improve their customers' user experience, e.g. offering more attractive rewards and adding various entertainment activities to motivate users to actively participate in knowledge sharing and innovation.

[1]  Sevgi Özkan,et al.  Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation , 2009, Comput. Educ..

[2]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[3]  Dong-Youl Jeong,et al.  An Empirical Study on Web-based Question-Answer Services , 2004 .

[4]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[5]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[6]  Edward A. Fox,et al.  Users, user interfaces, and objects: Envision, a digital library , 1993 .

[7]  Brigitte Maier,et al.  Students' expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction , 2010, Comput. Educ..

[8]  Tao Qiu-yan Evaluation of Search Engine from the Perspective of Customer Experience , 2013 .

[9]  Brian Kenney Liverpool's Discovery: A University Library Applies a New Search Tool to Improve the User Experience. , 2011 .

[10]  Xiao Ling Kathy Jin Understanding the sustainability of online question answering communities in China : the case of "Yahoo! Answers China" , 2009 .

[11]  Sanghee Oh,et al.  Users' relevance criteria for evaluating answers in a social Q&A site , 2009, J. Assoc. Inf. Sci. Technol..

[12]  Junjie Yao,et al.  Routing Questions to the Right Users in Online Communities , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[13]  Derek E. Baird,et al.  Neomillennial User Experience Design Strategies: Utilizing Social Networking Media to Support “Always on” Learning Styles , 2005 .

[14]  Jaehyun Park,et al.  Modeling user experience: A case study on a mobile device , 2013 .

[15]  Sascha Mahlke,et al.  Factors influencing the experience of website usage , 2002, CHI Extended Abstracts.

[16]  Sanghee Oh,et al.  The relationships between motivations and answering strategies: An exploratory review of health answerers' behaviors in Yahoo! answers , 2011, ASIST.

[17]  Alexandre N. Tuch,et al.  Is beautiful really usable? Toward understanding the relation between usability, aesthetics, and affect in HCI , 2012, Comput. Hum. Behav..

[18]  Yong Yu,et al.  Tapping on the potential of q&a community by recommending answer providers , 2008, CIKM '08.

[19]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[20]  Wynne W. Chin The partial least squares approach for structural equation modeling. , 1998 .

[21]  Les Gasser,et al.  Assessing Information Quality of a Community-Based Encyclopedia , 2005, ICIQ.

[22]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[23]  Angeliki Poulymenakou,et al.  Developing a Usability Evaluation Method for e-Learning Applications: Beyond Functional Usability , 2009, Int. J. Hum. Comput. Interact..

[24]  Faisal Taher,et al.  Exploring the facebook experience: a new approach to usability , 2008, NordiCHI.

[25]  Kar Yan Tam,et al.  Understanding User Acceptance of Digital Libraries: What are the Roles of Interface Characteristics, Organizational Context, and Individual Differences? , 2002, Int. J. Hum. Comput. Stud..

[26]  Bart P. Knijnenburg,et al.  Explaining the user experience of recommender systems , 2012, User Modeling and User-Adapted Interaction.

[27]  Fred D. Davis,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1 , 1992 .

[28]  Yunhee Lee TOWARD A NEW KNOWLEDGE SHARING COMMUNITY: COLLECTIVE INTELLIGENCE AND LEARNING THROUGH WEB-PORTAL-BASED QUESTION-ANSWER SERVICES , 2006 .

[29]  Paul van Schaik,et al.  Modelling user experience with web sites: Usability, hedonic value, beauty and goodness , 2008, Interact. Comput..

[30]  David F. Larcker,et al.  Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics: , 1981 .

[31]  M. Thüring,et al.  Usability, aesthetics and emotions in human–technology interaction , 2007 .

[32]  Michael Burmester,et al.  Hedonic and ergonomic quality aspects determine a software's appeal , 2000, CHI.

[33]  Jie Zhou,et al.  A New Approach to Answerer Recommendation in Community Question Answering Services , 2012, ECIR.

[34]  Bo Qu,et al.  An evaluation of classification models for question topic categorization , 2012, J. Assoc. Inf. Sci. Technol..

[35]  Jeffrey Pomerantz,et al.  Evaluating and predicting answer quality in community QA , 2010, SIGIR.

[36]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[37]  Weblog Wikipedia,et al.  In Wikipedia the Free Encyclopedia , 2005 .

[38]  Snehasish Banerjee,et al.  So fast so good: An analysis of answer quality and answer speed in community Question-answering sites , 2013, J. Assoc. Inf. Sci. Technol..

[39]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[40]  J. Hair Multivariate data analysis , 1972 .

[41]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[42]  Irwin King,et al.  Routing questions to appropriate answerers in community question answering services , 2010, CIKM.

[43]  Jesse James Garrett The Elements of User Experience: User-Centered Design for the Web , 2002 .

[44]  Sanghee Oh,et al.  Best-answer selection criteria in a social Q&A site from the user-oriented relevance perspective , 2008, ASIST.

[45]  A. Ant Ozok,et al.  Design guidelines for effective recommender system interfaces based on a usability criteria conceptual model: results from a college student population , 2010, Behav. Inf. Technol..

[46]  Iryna Gurevych,et al.  A Multi-Dimensional Model for Assessing the Quality of Answers in Social Q&A Sites , 2009, ICIQ.