Health answer quality evaluation by librarians, nurses, and users in social Q&A

Abstract Health information consumers and patients increasingly take an active role in seeking health information online and in sharing their health problems and concerns in online support groups and social media venues. However, they may risk being influenced by unreliable and misleading information in such environments, as no intermediaries monitor the quality of this information. This study focuses on evaluating the quality of health information exchanged in one of the social media venues, by investigating how librarians, nurses, and users assessed the quality of health answers in Yahoo! Answers, a social question-and-answering (Q&A) service. Through statistical analysis differences among the three participant groups, how the background characteristics influenced their assessments, and the relationships between characteristics of the content of answers and quality evaluation criteria were each considered in detail. Librarians and nurses shared similar ratings of answer quality, but had differences in their level of medical knowledge and the types of services they offer, resulting in minor differences across criteria. Users perceived the quality of health answers in social Q&A to be higher than librarians and nurses for almost all criteria. Depending on the sources of information presented in health answers, librarians, nurses, and users gave different quality assessments. Implications exist for research into and practice of evaluating the quality of health information, which need to address both search and domain expertise along with the sharing of socioemotional values preferred by users.

[1]  W. Bruce Croft,et al.  A framework to predict the quality of answers with non-textual features , 2006, SIGIR.

[2]  Soo Young Rieh,et al.  Interaction on the Web: Scholars' Judgment of Information Quality and Cognitive Authority , 2000 .

[3]  Ruti Volk Expert searching in consumer health: an important role for librarians in the age of the Internet and the Web. , 2007, Journal of the Medical Library Association : JMLA.

[4]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[5]  Soo Young Rieh Judgement of information quality and cognitive authority in the Web , 2002 .

[6]  Eugene Agichtein,et al.  Predicting information seeker satisfaction in community question answering , 2008, SIGIR '08.

[7]  Chirag Shah,et al.  The use of information sources by internet users in answering questions , 2008, ASIST.

[8]  H. Winefield,et al.  Breast and Prostate Cancer Online Discussion Boards , 2007, Journal of health psychology.

[9]  M. Breckons,et al.  What Do Evaluation Instruments Tell Us About the Quality of Complementary Medicine Information on the Internet? , 2007, Journal of medical Internet research.

[10]  Besiki Stvilia,et al.  A model for online consumer health information quality , 2009, J. Assoc. Inf. Sci. Technol..

[11]  Elizabeth Sillence,et al.  Going online for health advice: Changes in usage and trust practices over the last five years , 2007, Interact. Comput..

[12]  Pnina Fichman,et al.  A comparative assessment of answer quality on four question answering sites , 2011, J. Inf. Sci..

[13]  Justin Starren,et al.  Consumer Health Informatics and Telehealth , 2006 .

[14]  Jennifer Preece,et al.  Empathy online , 2005, Virtual Reality.

[15]  Ellen R. Tauber,et al.  Experts vs. Online Consumers: A Comparative Credibility Study of Health and Finance Web Sites , 2002 .

[16]  Sanghee Oh,et al.  The characteristics and motivations of health answerers for sharing information, knowledge, and experiences in online environments , 2012, J. Assoc. Inf. Sci. Technol..

[17]  Soo Young Rieh Judgment of information quality and cognitive authority in the Web , 2002, J. Assoc. Inf. Sci. Technol..

[18]  Christian Köhler,et al.  How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews , 2002, BMJ : British Medical Journal.

[19]  Besiki Stvilia,et al.  Disorderly reasoning in information design , 2009 .

[20]  Adam Worrall,et al.  Quality of health answers in social Q&A , 2012, ASIST.

[21]  Peter R. Harris,et al.  How do patients evaluate and make use of online health information? , 2007, Social science & medicine.

[22]  J. Pennbridge,et al.  Questionnaire survey of California consumers' use and rating of sources of health care information including the Internet. , 1999, The Western journal of medicine.

[23]  Kim Soojung,et al.  Questioners' credibility judgments of answers in a social question and answer site , 2010 .

[24]  Alton Yeow-Kuan Chua,et al.  A predictive framework for retrieving the best answer , 2008, SAC '08.

[25]  G. Eysenbach Medicine 2.0: Social Networking, Collaboration, Participation, Apomediation, and Openness , 2008, Journal of medical Internet research.

[26]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[27]  L. A. Marshall,et al.  Health information: does quality count for the consumer? , 2006, J. Libr. Inf. Sci..

[28]  S. Ziebland,et al.  What do patients with prostate or breast cancer want from an Internet site? A qualitative study of information needs. , 2004, Patient education and counseling.

[29]  J. Wareham,et al.  Health 2.0 and Medicine 2.0: Tensions and Controversies in the Field , 2008, Journal of medical Internet research.

[30]  Leah S. Larkey,et al.  Automatic essay grading using text categorization techniques , 1998, SIGIR '98.

[31]  R Mears,et al.  A preliminary study of the decision-making process within general practice. , 2000, Family practice.

[32]  Iryna Gurevych,et al.  A Multi-Dimensional Model for Assessing the Quality of Answers in Social Q&A Sites , 2009, ICIQ.

[33]  Chirag Shah,et al.  Faster, better, or both? Looking at both sides of online question-answering coin , 2011, ASIST.

[34]  Sheizaf Rafaeli,et al.  Predictors of answer quality in online Q&A sites , 2008, CHI.

[35]  J. Frost,et al.  Social Uses of Personal Health Information Within PatientsLikeMe, an Online Patient Community: What Can Happen When Patients Have Access to One Another’s Data , 2008, Journal of medical Internet research.

[36]  Sanghee Oh,et al.  Web resource selection behavior patterns of social media users in health: A comparison of Yahoo! Answers and delicious , 2011, ASIST.

[37]  HON code of conduct for medical and health Web sites. , 2000, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[38]  Gary Burnett,et al.  Information Exchange in Virtual Communities: A Comparative Study , 2006, J. Comput. Mediat. Commun..

[39]  Jeffrey Pomerantz,et al.  Evaluating and predicting answer quality in community QA , 2010, SIGIR.

[40]  P. Briggs,et al.  Trust in Online Advice , 2002 .

[41]  J. Powell,et al.  Primary care Health related virtual communities and electronic support groups : systematic review of the effects of online peer to peer interactions , 2004 .

[42]  Jimmy J. Lin,et al.  What Makes a Good Answer? The Role of Context in Question Answering , 2003, INTERACT.

[43]  Aled Jones Nurses talking to patients: exploring conversation analysis as a means of researching nurse-patient communication. , 2003, International journal of nursing studies.

[44]  Sanghee Oh,et al.  Users' relevance criteria for evaluating answers in a social Q&A site , 2009, J. Assoc. Inf. Sci. Technol..