The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments

People regularly use web search engines to investigate the efficacy of medical treatments. Search results can contain documents that present incorrect information that contradicts current established medical understanding on whether a treatment is helpful or not for a health issue. If people are influenced by the incorrect information found in search results, they can make harmful decisions about the appropriate treatment. To determine the extent to which people can be influenced by search engine results, we conducted a controlled laboratory study that biased search results towards correct or incorrect information for 10 different medical treatments. We found that search engine results can significantly influence people both positively and negatively. Importantly, study participants made more incorrect decisions when they interacted with search results biased towards incorrect information than when they had no interaction with search results at all. For search domains such as health information, search engine designers and researchers must recognize that not all non-relevant information is the same. Some non-relevant information is incorrect and potentially harmful when people use it to make decisions that may negatively impact their lives.

[1]  Ryen W. White,et al.  Content Bias in Online Health Search , 2014, TWEB.

[2]  Krishna P. Gummadi,et al.  Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media , 2017, CSCW.

[3]  Yadan Ouyang Student's death highlights gaps in China's health regulations. , 2016, The Lancet. Oncology.

[4]  Yvonne Kammerer,et al.  The role of Internet-specific epistemic beliefs in laypersons' source evaluations and decisions during Web search on a medical issue , 2013, Comput. Hum. Behav..

[5]  Ryen W. White Beliefs and biases in web search , 2013, SIGIR.

[6]  Thorsten Joachims,et al.  In Google We Trust: Users' Decisions on Rank, Position, and Relevance , 2007, J. Comput. Mediat. Commun..

[7]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[8]  Ryen W. White Belief dynamics in web search , 2014, J. Assoc. Inf. Sci. Technol..

[9]  Pamela C Sieving,et al.  WHAT IS A COCHRANE REVIEW? , 2007, ORL-head and neck nursing : official journal of the Society of Otorhinolaryngology and Head-Neck Nurses.

[10]  M. S. Schnier To the editor: Unorthodox cancer medicine , 1989, CA: a cancer journal for clinicians.

[11]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[12]  Ronald E. Robertson,et al.  The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections , 2015, Proceedings of the National Academy of Sciences.

[13]  Ryen W. White,et al.  Belief Dynamics and Biases in Web Search , 2015, ACM Trans. Inf. Syst..