Health outcomes of online consumer health information: A systematic mixed studies review with framework synthesis

The Internet has become the first source of consumer health information. Most theoretical and empirical studies are centered on information needs and seeking, rather than on information outcomes. This review's purpose is to explore and explain health outcomes of Online Consumer Health Information (OCHI) in primary care. A participatory systematic mixed studies review with a framework synthesis was undertaken. Starting from an initial conceptual framework, our specific objectives were to (a) identify types of OCHI outcomes in primary care, (b) identify factors associated with these outcomes, and (c) integrate these factors and outcomes into a comprehensive revised framework combining an information theory and a psychosocial theory of behavior. The results of 65 included studies were synthesized using a qualitative thematic data analysis. The themes derived from the literature underwent a harmonization process that produced a comprehensive typology of OCHI outcomes. The revised conceptual framework specifies four individual and one organizational level of OCHI outcomes, while including factors such as consumers' information needs and four interdependent contextual factors. It contributes to theoretical knowledge about OCHI health outcomes, and informs future research, information assessment methods, and tools to help consumers find and use health information.

[1]  Jacques Simard,et al.  Systematic mixed-methods reviews are not ready to be assessed with the available tools. , 2011, Journal of clinical epidemiology.

[2]  J. Higgins.  Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[3]  Stefano Bussolon,et al.  Card Sorting, Category Validity, and Contextual Navigation , 2009 .

[4]  H. Maibom.  Social Systems , 2007 .

[5]  Paul M. Leonardi,et al.  When Flexible Routines Meet Flexible Technologies: Affordance, Constraint, and the Imbrication of Human and Material Agencies , 2011, MIS Q..

[6]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[7]  Pierre Pluye,et al.  Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. , 2014, Annual review of public health.

[8]  Reijo Savolainen.  Information Behavior and Information Practice: Reviewing the “Umbrella Concepts” of Information‐Seeking Studies1 , 2007, The Library Quarterly.

[9]  P. Pluye,et al.  Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence , 2017, Systematic Reviews.

[10]  Ann M. Florini.  Introduction. The Battle Over Transparency , 2007 .

[11]  Pierre Pluye,et al.  Performance of a mixed filter to identify relevant studies for mixed studies reviews. , 2016, Journal of the Medical Library Association : JMLA.

[12]  A. Booth,et al.  “Best fit” framework synthesis: refining the method , 2013, BMC Medical Research Methodology.

[13]  Paul T. Jaeger,et al.  Small worlds, lifeworlds, and information: the ramifications of the information behaviour of social groups in public policy and the public sphere , 2008, Inf. Res..

[14]  Julie Hersberger.  Are the economically poor information poor? Does the digital divide affect the homeless and access to information? , 2013 .

[15]  Agne Suziedelyte,et al.  How does searching for health information on the Internet affect individuals' demand for health care services? , 2012, Social science & medicine.

[16]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[17]  B. Starfield,et al.  Contribution of primary care to health systems and health. , 2005, The Milbank quarterly.

[18]  William E Hogg,et al.  Primary Care (PC) and Primary Health Care (PHC) , 2006, Canadian journal of public health = Revue canadienne de sante publique.

[19]  P. Pluye,et al.  Systematic mixed studies reviews: updating results on the reliability and efficiency of the Mixed Methods Appraisal Tool. , 2015, International journal of nursing studies.

[20]  R. Fidel,et al.  Conceptual Frameworks in Information Behavior. , 2001 .

[21]  Reijo Savolainen,et al.  Network competence and information seeking on the Internet: From definitions towards a social cognitive model , 2002, J. Documentation.

[22]  J. Prochaska,et al.  The transtheoretical model and stages of change. , 1996 .

[23]  Johannes J. Britz,et al.  To Know or not to Know: A Moral Reflection on Information Poverty , 2004, J. Inf. Sci..

[24]  J. Feinglass,et al.  Health Literacy and Mortality Among Elderly Persons , 2007 .

[25]  Rachel Churchill,et al.  ROBIS: A new tool to assess risk of bias in systematic reviews was developed , 2016, Journal of clinical epidemiology.

[26]  P. Klemm,et al.  The Internet: friend or foe when providing patient education? , 2008, Clinical journal of oncology nursing.

[27]  Maria J Grant,et al.  A typology of reviews: an analysis of 14 review types and associated methodologies. , 2009, Health information and libraries journal.

[28]  Michael Crowe,et al.  A review of critical appraisal tools show they lack rigor: Alternative tool structure is proposed. , 2011, Journal of clinical epidemiology.

[29]  Hendrik Kockaert,et al.  Handbook of terminology , 2015 .

[30]  Paul B. Kantor,et al.  Studying the Value of Library and Information Services. Part I: Establishing a Theoretical Framework. , 1997 .

[31]  A. Harden,et al.  Methods for the thematic synthesis of qualitative research in systematic reviews , 2008, BMC medical research methodology.

[32]  G. Godin.  Les comportements dans le domaine de la santé : comprendre pour mieux intervenir , 2012 .

[33]  Ed H. Chi,et al.  Towards a model of understanding social search , 2008, SSM '08.

[34]  Patrick Onghena,et al.  Using Mixed Methods Research Synthesis for Literature Reviews , 2016 .

[35]  Paul Solomon,et al.  Looking for Information—A Survey of Research on Information Seeking, Needs, and Behavior , 2003, Information Retrieval.

[36]  J F Thaulow,et al.  [About communication]. , 1999, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[37]  Tefko Saracevic.  Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance , 2007 .

[38]  S. Altan Erdem,et al.  The role of the Internet in physician–patient relationships: The issue of trust , 2006 .

[39]  Baiba Berzins,et al.  The Development of PROQOL-HIV: An International Instrument to Assess the Health-Related Quality of Life of Persons Living With HIV/AIDS , 2012, Journal of acquired immune deficiency syndromes.

[40]  Jan van Dijk,et al.  Toward a Multifaceted Model of Internet Access for Understanding Digital Divides: An Empirical Investigation , 2015, Inf. Soc..

[41]  Robert E. Buntrock,et al.  Information and Emotion: The Emergent Affective Paradigm in Information Behavior Research and Theory , 2009, J. Chem. Inf. Model..

[42]  Christina Courtright.  Context in information behavior research , 2007 .

[43]  S. Oliver,et al.  Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ , 2012, BMC Medical Research Methodology.

[44]  Adrian Edwards,et al.  What are the external influences on information exchange and shared decision-making in healthcare consultations: a meta-synthesis of the literature. , 2009, Patient education and counseling.

[45]  C. Knapp,et al.  Internet Use and eHealth Literacy of Low-Income Parents Whose Children Have Special Health Care Needs , 2011, Journal of medical Internet research.

[46]  W. V. Lerberghe,et al.  The World Health Report 2008 Primary Health Care – Now More Than Ever 100 Adapting reforms to country context , 2008 .

[47]  Devon L. Greyson,et al.  The role of information in health behavior: A scoping study and discussion of major public health models , 2016, J. Assoc. Inf. Sci. Technol..

[48]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[49]  Mark Duman,et al.  The state of consumer health information: an overview. , 2009, Health information and libraries journal.

[50]  P. Pluye,et al.  Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. , 2012, International journal of nursing studies.

[51]  Pierre Pluye,et al.  Reducing Negative Outcomes of Online Consumer Health Information: Qualitative Interpretive Study with Clinicians, Librarians, and Consumers , 2018, Journal of medical Internet research.

[52]  I. Rosenstock,et al.  Social Learning Theory and the Health Belief Model , 1988, Health education quarterly.

[53]  R. Desjardins,et al.  Health Literacy in Canada: A Healthy Understanding , 2008 .

[54]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[55]  A. Bandura.  Health Promotion by Social Cognitive Means , 2004, Health education & behavior : the official publication of the Society for Public Health Education.

[56]  T. Saracevic,et al.  Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: nature and manifestations of relevance , 2007, J. Assoc. Inf. Sci. Technol..

[57]  Karen E. Fisher,et al.  Social spaces, casual interactions, meaningful exchanges: 'information ground' characteristics based on the college student experience , 2007, Inf. Res..

[58]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[59]  Elfreda A. Chatman,et al.  The Impoverished Life-World of Outsiders , 1996, J. Am. Soc. Inf. Sci..

[60]  David A. Kindig,et al.  Health literacy : a prescription to end confusion , 2004 .

[61]  T. D. Wilson,et al.  Revisiting user studies and information needs , 2006, J. Documentation.

[62]  T. D. Wilson,et al.  On user studies and information needs , 2006, J. Documentation.

[63]  Pierre Pluye,et al.  Patient Information Aid: An innovative educational program to improve outcomes of online consumer health information , 2019, Educ. Inf..

[64]  Julio Frenk,et al.  Reinventing primary health care: the need for systems integration , 2009, The Lancet.

[65]  Cathy Schoen,et al.  Mirror, Mirror on the Wall, 2014 Update: How the U.S. Health Care System Compares Internationally , 2014 .

[66]  J. Fereday,et al.  Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development , 2006 .

[67]  Richard L Street,et al.  How clinician-patient communication contributes to health improvement: modeling pathways from talk to outcome. , 2013, Patient education and counseling.

[68]  Sylvie Dubois,et al.  Beyond the mere dichotomy of active search versus avoidance of information about the self. , 2006, Journal of the Medical Library Association : JMLA.

[69]  Robert James Campbell.  Internet-Based Health Information Seeking Among Low-Income, Minority Seniors Living in Urban Residential Centers , 2009 .

[70]  Lisl Zach,et al.  Assessing internet access and use in a medically underserved population: implications for providing enhanced health information services. , 2012, Health information and libraries journal.

[71]  Wendy Armstrong,et al.  Building on Values: The Future of Health Care in Canada , 2005 .

[72]  Pierre Pluye,et al.  Development and Content Validation of the Information Assessment Method for Patients and Consumers , 2014, JMIR research protocols.

[73]  P. Pluye,et al.  Ecological content validation of the Information Assessment Method for parents (IAM-parent): A mixed methods study. , 2018, Evaluation and program planning.

[74]  Liangzhi Yu,et al.  Understanding information inequality : Making sense of the literature of the information and digital , 2006 .

[75]  I. Ajzen,et al.  Predicting and Changing Behavior: The Reasoned Action Approach , 2009 .

[76]  Donald Owen Case,et al.  What's the use? Measuring the frequency of studies of information outcomes , 2016, J. Assoc. Inf. Sci. Technol..

[77]  Tefko Saracevic,et al.  Relevance : A Review of the Literature and a Framework for Thinking on the Notion in Information Science . Part III : Behavior and Effects of Relevance , 1976 .

[78]  Roland M. Grad,et al.  Perceived outcomes of online parenting information according to self‐selected participants from a population of website users , 2015, ASIST.

[79]  Ann Florini,et al.  The Right to Know: Transparency for an Open World , 2007 .

[80]  C. Urquhart,et al.  Reflections on the value and impact of library and information services: Part 2: impact assessment , 2016 .

[81]  Jacques Lesourne,et al.  Le nouveau management : la decision par les ordinateurs , 1980 .

[82]  Suprateek Sarker,et al.  Guest editorial: qualitative studies in information systems: a critical review and some guiding principles , 2013 .

[83]  Roy Balleste,et al.  RISING TOWARD APOTHEOSIS: THE DECONSTRUCTION OF THE WSIS TUNIS AGENDA FOR THE INFORMATION SOCIETY , 2012 .

[84]  S. Ziebland,et al.  Health and Illness in a Connected World: How Might Sharing Experiences on the Internet Affect People's Health? , 2012, The Milbank quarterly.

[85]  Linda Cloete.  Looking for Information: A Survey of Research on Information Seeking, Needs and Behavior, 3rd ed. , 2013 .

[86]  Roland M. Grad,et al.  Four levels of outcomes of information-seeking: A mixed methods study in primary health care , 2013, J. Assoc. Inf. Sci. Technol..

[87]  Annemaree Lloyd,et al.  Connecting with new information landscapes: information literacy practices of refugees , 2013, J. Documentation.

[88]  P. Pluye,et al.  A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. , 2009, International journal of nursing studies.

[89]  Alex Byrne.  World Summit on the Information Society (WSIS) , 2009 .

[90]  S. Koss,et al.  Consumer health information: a federal perspective on a important aspect of the national information infrastructure , 1995, Proceedings of the Second International Workshop on Community Networking 'Integrated Multimedia Services to the Home'.

[91]  J. Powell,et al.  The Characteristics and Motivations of Online Health Information Seekers: Cross-Sectional Survey and Qualitative Interview Study , 2011, Journal of medical Internet research.

[92]  P. Pluye,et al.  Opening-up the definition of systematic literature review: the plurality of worldviews, methodologies and methods for reviews and syntheses. , 2016, Journal of clinical epidemiology.

[93]  Bo Xie,et al.  Public library computer training for older adults to access high-quality Internet health information. , 2009, Library & information science research.

[94]  Dean Giustini,et al.  De-duplication of database search results for systematic reviews in EndNote. , 2016, Journal of the Medical Library Association : JMLA.

[95]  Gordon Rugg,et al.  The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts , 1997, Expert Syst. J. Knowl. Eng..

[96]  Andrew Abbott,et al.  The Causal Devolution , 1998 .

[97]  C. Chronaki,et al.  Informed citizen and empowered citizen in health: results from an European survey , 2011, BMC family practice.

[98]  Suzanne Austin Boren,et al.  Linking clinic patients to Internet-based, condition-specific information prescriptions. , 2010, Journal of the Medical Library Association : JMLA.

[99]  S. Michie,et al.  The behaviour change wheel: A new method for characterising and designing behaviour change interventions , 2011, Implementation science : IS.