Modalities, motivations, and materials – investigating traditional and social online Q&A services

With the advent of ubiquitous connectivity and a constant flux of user-generated content, people’s online information-seeking behaviours are rapidly changing, one o f which includes seeking information from peers through online questioning. Ways to understand this new behaviour can be broken down into three aspects, also referred to as the three M’s – the modalities (sources and strategies) that people use when asking their questions online, their motivations behind asking these questions and choosing specific services, and the types and quality of the materials (content) generated in such an online Q&A environment. This article will provide a new framework – three M’s – based on the synthesis of relevant literature. It will then identify some of the gaps in our knowledge about online Q&A based on this framework. These gaps will be transformed into six research questions, stemming from the three M’s, and addressed by (a) consolidating and synthesizing findings previously reported in the literature, (b) conducting new analyses of data used in prior work, and (c) administering a new study to answer questions unaddressed by the pre-existing and new analyses of prior work.

[1]  Carol L. Barry,et al.  Users' Criteria for Relevance Evaluation: A Cross-situational Comparison , 1998, Inf. Process. Manag..

[2]  Chirag Shah,et al.  Faster, better, or both? Looking at both sides of online question-answering coin , 2011, ASIST.

[3]  Chirag Shah Measuring effectiveness and user satisfaction in Yahoo! Answers , 2011, First Monday.

[4]  Yan Chen,et al.  Re-examining price as a predictor of answer quality in an online q&a site , 2010, CHI.

[5]  Teck-Hua Ho,et al.  Knowledge Market Design: A Field Experiment at Google Answers , 2010 .

[6]  Sanghee Oh,et al.  Evaluating health answers in a social Q&A site , 2009, ASIST.

[7]  Kai H. Lim,et al.  Contributing high quantity and quality knowledge to online Q&A communities , 2013, J. Assoc. Inf. Sci. Technol..

[8]  Pnina Shachaf,et al.  Virtual reference service evaluation: Adherence to RUSA behavioral guidelines and IFLA digital reference guidelines , 2008 .

[9]  Omar Alonso,et al.  Relevance criteria for e-commerce: a crowdsourcing-based experimental analysis , 2009, SIGIR.

[10]  Tefko Saracevic,et al.  The Stratified Model of Information Retrieval Interaction: Extension and Applications , 1997 .

[11]  Wendy Duff,et al.  A Virtual Expression of Need: An Analysis of E-mail Reference Questions , 2007 .

[12]  Wiley Interscience Journal of the American Society for Information Science and Technology , 2013 .

[13]  J. Oh,et al.  Research agenda for social Q&A , 2009 .

[14]  Gary Marchionini,et al.  Information Concepts: From Books to Cyberspace Identities , 2010, Information Concepts: From Books to Cyberspace Identities.

[15]  Tsai-Youn Hung,et al.  Relevance Judgments for Image Retrieval in the Field of Journalism: A Pilot Study , 2005, ICADL.

[16]  Lynn Silipigni Connaway,et al.  Seeking Synchronicity: Revelations and Recommendations for Virtual Reference. , 2011 .

[17]  Chirag Shah,et al.  Social Q&A and virtual reference - comparing apples and oranges with the help of experts and users , 2012, J. Assoc. Inf. Sci. Technol..

[18]  Meredith Ringel Morris,et al.  What do people ask their social networks, and why?: a survey study of status message q&a behavior , 2010, CHI.

[19]  F. Maxwell Harper,et al.  Question types in social Q&A sites , 2010, First Monday.

[20]  Jeffrey Pomerantz,et al.  Peer Review of Chat Reference Transcripts: Approaches and Strategies , 2006 .

[21]  Peter Pirolli,et al.  Do your friends make you smarter?: An analysis of social strategies in online information seeking , 2010, Inf. Process. Manag..

[22]  Rich Gazan,et al.  When Online Communities Become Self-Aware , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[23]  Kohei Arai,et al.  Predicting Quality of Answer in Collaborative Q/A Community , 2013 .

[24]  Dan Wu,et al.  A study on Q&A services between community-based question answering and collaborative digital reference in two languages , 2013 .

[25]  Mark S. Ackerman,et al.  Questions in, knowledge in?: a study of naver's question answering community , 2009, CHI.

[26]  Mike Thelwall,et al.  Synthesis Lectures on Information Concepts, Retrieval, and Services , 2009 .

[27]  Snehasish Banerjee,et al.  A Comparison of Quality, Speed, Scope and Usability between English and Chinese CQAs , 2013 .

[28]  Sharma Chakravarthy,et al.  Answer Quality Prediction in Q/A Social Networks by Leveraging Temporal Features , 2013, Int. J. Next Gener. Comput..

[29]  David S. Carter,et al.  Unobtrusive Data Analysis of Digital Reference Questions and Service at the Internet Public Library: An Exploratory Study , 2000, Libr. Trends.

[30]  Arthur R. Taylor,et al.  User relevance criteria choices and the information search process , 2012, Inf. Process. Manag..

[31]  Sanghee Oh,et al.  The characteristics and motivations of health answerers for sharing information, knowledge, and experiences in online environments , 2012, J. Assoc. Inf. Sci. Technol..

[32]  R A Hamid,et al.  Criteria that have an effect on users while making image relevance judgements , 2010, ADCS 2010.

[33]  Sheizaf Rafaeli,et al.  Predictors of answer quality in online Q&A sites , 2008, CHI.

[34]  Chirag Shah,et al.  Developing a typology of online Q&A models and recommending the right model for each question type , 2012, ASIST.

[35]  Edmund A. Mennis The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations , 2006 .

[36]  Lynn Silipigni Connaway,et al.  Mountains, Valleys, and Pathways: Serials Users' Needs and Steps to Meet Them , 2007 .

[37]  R. David Lankes The virtual reference experience : integrating theory into practice , 2004 .

[38]  I. J. Lee Do virtual reference librarians dream of digital reference questions?: a qualitative and quantitative analysis of e-mail and chat reference , 2004 .

[39]  Iryna Gurevych,et al.  Answering Learners’ Questions by Retrieving Question Paraphrases from Social Q&A Sites , 2008 .

[40]  Chirag Shah,et al.  Exploring Characteristics and Effects of User Participation in Online Social Q&A Sites , 2008, First Monday.

[41]  Adam Worrall,et al.  The place of health information and socio-emotional support in social questioning and answering , 2013, Inf. Res..

[42]  Audrey Laplante Users' Relevance Criteria in Music Retrieval in Everyday Life: An Exploratory Study , 2010, ISMIR.

[43]  Birger Hjørland,et al.  The foundation of the concept of relevance , 2010, J. Assoc. Inf. Sci. Technol..

[44]  Ed Jana Ronan Mls,et al.  Application of Reference Guidelines in Chat Reference Interactions , 2008 .

[45]  Pia Borlund,et al.  The concept of relevance in IR , 2003, J. Assoc. Inf. Sci. Technol..

[46]  Thomas J. Froehlich,et al.  Relevance Reconsidered - Towards an Agenda for the 21st Century: Introduction to Special Topic Issue on Relevance Research , 1994, J. Am. Soc. Inf. Sci..

[47]  Carol L. Barry User-Defined Relevance Criteria: An Exploratory Study , 1994, J. Am. Soc. Inf. Sci..

[48]  Jeffrey Pomerantz,et al.  Evaluating and predicting answer quality in community QA , 2010, SIGIR.

[49]  Yang Gao,et al.  Deceptive Answer Prediction with User Preference Graph , 2013, ACL.

[50]  Birger Hjørland The foundation of the concept of relevance , 2009 .

[51]  Snehasish Banerjee,et al.  So fast so good: An analysis of answer quality and answer speed in community Question-answering sites , 2013, J. Assoc. Inf. Sci. Technol..

[52]  Nicholas J. Belkin,et al.  Characteristics of Texts Affecting Relevance Judgments , 1993 .

[53]  Rich Gazan,et al.  Social Q&A , 2011, J. Assoc. Inf. Sci. Technol..

[54]  Marilyn Domas White,et al.  Evaluation of Chat Reference Service Quality: Pilot Study , 2003, D Lib Mag..

[55]  Linda Schamber Relevance and Information Behavior. , 1994 .

[56]  Marie L. Radford Relational aspects of reference interactions : a qualitative investigation of the perceptions of users and librarians in the academic library , 1993 .

[57]  Sanghee Oh,et al.  Best-answer selection criteria in a social Q&A site from the user-oriented relevance perspective , 2008, ASIST.

[58]  Melissa Gross,et al.  Assessing quality in digital reference services site visit reports , 2001 .

[59]  Marianne Foley,et al.  Instant Messaging Reference in an Academic Library: A Case Study , 2002 .

[60]  David R. Karger,et al.  Tie strength in question & answer on social network sites , 2012, CSCW '12.

[61]  Sanghee Oh,et al.  Users' relevance criteria for evaluating answers in a social Q&A site , 2009, J. Assoc. Inf. Sci. Technol..

[62]  Charles R. McClure,et al.  Assessing Quality in Digital Reference Services: Overview of Key Literature on Digital Reference , 2007 .

[63]  Rich Gazan,et al.  Seekers, sloths and social reference: Homework questions submitted to a question-answering community , 2007, New Rev. Hypermedia Multim..

[64]  Cathy H. C. Hsu,et al.  Expectation, Motivation, and Attitude: A Tourist Behavioral Model , 2010 .

[65]  Mor Naaman,et al.  Is it really about me?: message content in social awareness streams , 2010, CSCW '10.

[66]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[67]  Pnina Shachaf,et al.  A structuration approach to online communities of practice: The case of Q&A communities , 2010, J. Assoc. Inf. Sci. Technol..

[68]  Eugene Agichtein,et al.  Predicting information seeker satisfaction in community question answering , 2008, SIGIR '08.

[69]  F. Maxwell Harper,et al.  Facts or friends?: distinguishing informational and conversational questions in social Q&A sites , 2009, CHI.