The Use of Google Trends in Health Care Research: A Systematic Review

Background Google Trends is a novel, freely accessible tool that allows users to interact with Internet search data, which may provide deep insights into population behavior and health-related phenomena. However, there is limited knowledge about its potential uses and limitations. We therefore systematically reviewed health care literature using Google Trends to classify articles by topic and study aim; evaluate the methodology and validation of the tool; and address limitations for its use in research. Methods and Findings PRISMA guidelines were followed. Two independent reviewers systematically identified studies utilizing Google Trends for health care research from MEDLINE and PubMed. Seventy studies met our inclusion criteria. Google Trends publications increased seven-fold from 2009 to 2013. Studies were classified into four topic domains: infectious disease (27% of articles), mental health and substance use (24%), other non-communicable diseases (16%), and general population behavior (33%). By use, 27% of articles utilized Google Trends for casual inference, 39% for description, and 34% for surveillance. Among surveillance studies, 92% were validated against a reference standard data source, and 80% of studies using correlation had a correlation statistic ≥0.70. Overall, 67% of articles provided a rationale for their search input. However, only 7% of articles were reproducible based on complete documentation of search strategy. We present a checklist to facilitate appropriate methodological documentation for future studies. A limitation of the study is the challenge of classifying heterogeneous studies utilizing a novel data source. Conclusion Google Trends is being used to study health phenomena in a variety of topic domains in myriad ways. However, poor documentation of methods precludes the reproducibility of the findings. Such documentation would enable other researchers to determine the consistency of results provided by Google Trends for a well-specified query over time. Furthermore, greater transparency can improve its reliability as a research tool.

[1]  D. Sackett Bias in analytic research. , 1979, Journal of chronic diseases.

[2]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[3]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[4]  L. HARKing: Hypothesizing After the Results are Known , 2002 .

[5]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[6]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[7]  H. Varian,et al.  Predicting the Present with Google Trends , 2009 .

[8]  M. Postma,et al.  What's on the mind of IVF consumers? , 2009, Reproductive biomedicine online.

[9]  J. Brownstein,et al.  Digital disease detection--harnessing the Web for public health surveillance. , 2009, The New England journal of medicine.

[10]  Eleftherios Mylonakis,et al.  Google trends: a web-based tool for real-time surveillance of disease outbreaks. , 2009, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[11]  A. Flahault,et al.  More Diseases Tracked by Using Google Trends , 2009, Emerging infectious diseases.

[12]  B. Breyer,et al.  Use of Google in study of noninfectious medical conditions. , 2010, Epidemiology.

[13]  Christopher T. Leffler,et al.  Frequency and seasonal variation of ophthalmology-related internet searches. , 2010, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[14]  J. Brownstein,et al.  Measuring the impact of health policies using Internet search patterns: the case of abortion , 2010, BMC public health.

[15]  D. Mabey,et al.  Neglected tropical diseases. , 2010, British medical bulletin.

[16]  K. Murugiah,et al.  Cardiopulmonary resuscitation (CPR) survival rates and Internet search for CPR: is there a relation? , 2010, Resuscitation.

[17]  A. Valdivia,et al.  Diseases Tracked by Using Google Trends, Spain , 2010, Emerging infectious diseases.

[18]  J. Aucott,et al.  The utility of "Google Trends" for epidemiological research: Lyme disease as an example. , 2010, Geospatial health.

[19]  M. McCarthy,et al.  Internet monitoring of suicide risk in the population. , 2010, Journal of affective disorders.

[20]  L. McMahon,et al.  Using search engine query data to track pharmaceutical utilization: a study of statins. , 2010, The American journal of managed care.

[21]  Paul Ormerod,et al.  A rapid method for assessing social versus independent interest in health issues: a case study of 'bird flu' and 'swine flu'. , 2010, Social science & medicine.

[22]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[23]  C. Peng,et al.  Do Seasons Have an Influence on the Incidence of Depression? The Use of an Internet Search Engine Query Data as a Proxy of Human Affect , 2010, PloS one.

[24]  C. Peng,et al.  Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004-2009. , 2011, Journal of affective disorders.

[25]  D. Metcalfe,et al.  Media coverage and public reaction to a celebrity cancer diagnosis. , 2011, Journal of public health.

[26]  Jennifer Keelan,et al.  Natural Supplements for H1N1 Influenza: Retrospective Observational Infodemiology Study of Information and Search Activity on the Internet , 2011, Journal of medical Internet research.

[27]  B. Nahed,et al.  Determination of geographic variance in stroke prevalence using Internet search engine analytics. , 2011, Neurosurgical focus.

[28]  A. Hagihara,et al.  Internet suicide searches and the incidence of suicide in young people in Japan , 2011, European Archives of Psychiatry and Clinical Neuroscience.

[29]  Nathan Tefft,et al.  Journal of Health Economics , 2022 .

[30]  Diane S. Lauderdale,et al.  Internet Queries and Methicillin-Resistant Staphylococcus aureus Surveillance , 2011, Emerging Infectious Diseases.

[31]  David Gunnell,et al.  Surveillance of Australian Suicidal Behaviour Using the Internet? , 2011, The Australian and New Zealand journal of psychiatry.

[32]  Jieping Ye,et al.  Tuberculosis Surveillance by Analyzing Google Trends , 2011, IEEE Transactions on Biomedical Engineering.

[33]  William M. Tierney,et al.  A Nationwide Framework for Surveillance of Cardiovascular and Chronic Lung Diseases , 2011 .

[34]  D. Cummings,et al.  Prediction of Dengue Incidence Using Search Query Surveillance , 2011, PLoS neglected tropical diseases.

[35]  J. Brownstein,et al.  Tracking the rise in popularity of electronic nicotine delivery systems (electronic cigarettes) using search query surveillance. , 2011, American journal of preventive medicine.

[36]  H. Sueki Does the volume of Internet searches using suicide‐related search terms influence the suicide death rate: Data from 2004 to 2009 in Japan , 2011, Psychiatry and clinical neurosciences.

[37]  Michael J Kerin,et al.  The effect of breast cancer awareness month on internet search activity - a comparison with awareness campaigns for lung and prostate cancer , 2011, BMC Cancer.

[38]  John S. Brownstein,et al.  Using Search Query Surveillance to Monitor Tax Avoidance and Smoking Cessation following the United States' 2009 “SCHIP” Cigarette Tax Increase , 2011, PloS one.

[39]  P. Santaguida,et al.  Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions , 2012 .

[40]  Yossi Matias,et al.  Norovirus disease surveillance using Google Internet query share data. , 2012, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[41]  L. Donaldson,et al.  Influenza A(H1N1)pdm09 in England, 2009 to 2011: a greater burden of severe illness in the year after the pandemic than in the pandemic year. , 2012, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[42]  H. Varian,et al.  Predicting the Present with Google Trends , 2012 .

[43]  Mona L. Ho,et al.  Monitoring a toxicological outbreak using Internet search query data , 2012, Clinical toxicology.

[44]  A. Forsyth Virtually a drug scare: mephedrone and the impact of the internet on drug news transmission. , 2012, The International journal on drug policy.

[45]  Suzanne Fergus,et al.  5,6‐Methylenedioxy‐2‐aminoindane: from laboratory curiosity to ‘legal high’ , 2012, Human psychopharmacology.

[46]  J. Schunk,et al.  Should we fear "flu fear" itself? Effects of H1N1 influenza fear on ED use. , 2012, The American journal of emergency medicine.

[47]  Interest in Anesthesia as Reflected by Keyword Searches using Common Search Engines. , 2012, Journal of anesthesia & clinical research.

[48]  Miguel-Angel Sicilia,et al.  Syndromic surveillance models using Web data: The case of scarlet fever in the UK , 2012, Informatics for health & social care.

[49]  Lucas J Carr,et al.  Search Query Data to Monitor Interest in Behavior Change: Application for Public Health , 2012, PloS one.

[50]  Rishi Desai,et al.  Use of Internet search data to monitor impact of rotavirus vaccination in the United States. , 2012, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[51]  Jon-Patrick Allem,et al.  A Novel Evaluation of World No Tobacco Day in Latin America , 2012, Journal of medical Internet research.

[52]  R. Vuento,et al.  Increased incidence of Mycoplasma pneumoniae infection in Finland, 2010-2011. , 2012, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[53]  N. Davis,et al.  Detecting internet activity for erectile dysfunction using search engine query data in the Republic of Ireland , 2012, BJU international.

[54]  J. Brownstein,et al.  Novel surveillance of psychological distress during the great recession. , 2012, Journal of affective disorders.

[55]  D. Ingram,et al.  Seasonal trends in restless legs symptomatology: evidence from Internet search query data. , 2013, Sleep medicine.

[56]  R. Kane,et al.  Kronic hysteria: exploring the intersection between Australian synthetic cannabis legislation, the media, and drug-related harm. , 2013, The International journal on drug policy.

[57]  Camille Pelat,et al.  A Method to Assess Seasonality of Urinary Tract Infections Based on Medication Sales and Google Trends , 2013, PloS one.

[58]  S. Willard,et al.  Internet search trends analysis tools can provide real-time data on kidney stone disease in the United States. , 2013, Urology.

[59]  Nicola Luigi Bragazzi,et al.  Psychology Research and Behavior Management Dovepress a Google Trends-based Approach for Monitoring Nssi , 2022 .

[60]  D. Lester,et al.  Using google searches on the internet to monitor suicidal behavior. , 2013, Journal of affective disorders.

[61]  Jae Ho Lee,et al.  Correlation between National Influenza Surveillance Data and Google Trends in South Korea , 2013, PloS one.

[62]  N. Davis,et al.  Using Google Trends to assess global interest in 'Dysport®' for the treatment of overactive bladder. , 2013, Urology.

[63]  Haran Burri,et al.  The MOnitoring Resynchronization dEvices and CARdiac patiEnts (MORE-CARE) Randomized Controlled Trial: Phase 1 Results on Dynamics of Early Intervention With Remote Monitoring , 2013, Journal of medical Internet research.

[64]  Grace Lordan,et al.  Exploring the relationship between macroeconomic conditions and problem drinking as captured by Google searches in the US , 2013 .

[65]  Jordi Mondria,et al.  Imperfect Financial Integration and Asymmetric Information: Competing Explanations of the Home Bias Puzzle? (Intégration Financière Imparfaite Et Information Asymétrique: Explications Concurrentes De L’Énigme Du Biais En Faveur Du Marché Domestique?)  , 2013 .

[66]  Patty Kostkova,et al.  Major Infection Events Over 5 Years: How Is Media Coverage Influencing Online Information Needs of Health Care Professionals and the Public? , 2013, Journal of medical Internet research.

[67]  Patrick M. Markey,et al.  Seasonal Variation in Internet Keyword Searches: A Proxy Assessment of Sex Mating Behaviors , 2013, Archives of sexual behavior.

[68]  S. Rutherford,et al.  Using Google Trends for Influenza Surveillance in South China , 2013, PloS one.

[69]  Han Zhao,et al.  Monitoring Epidemic Alert Levels by Analyzing Internet Search Volume , 2013, IEEE Transactions on Biomedical Engineering.

[70]  Nicola Luigi Bragazzi,et al.  Infodemiology and Infoveillance of Multiple Sclerosis in Italy , 2013, Multiple sclerosis international.

[71]  J. Ayers,et al.  Seasonality in seeking mental health information on Google. , 2013, American journal of preventive medicine.

[72]  Pinar Karaca-Mandic,et al.  Predicting new diagnoses of HIV infection using internet search engine data. , 2013, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[73]  Gerardo Chowell,et al.  Skip the Trip: Air Travelers' Behavioral Responses to Pandemic Influenza , 2013, PloS one.

[74]  Sherry Emery,et al.  Assessing the Impact of the National Smoking Ban in Indoor Public Places in China: Evidence from Quit Smoking Related Online Searches , 2013, PloS one.

[75]  M. Kicinski Publication Bias in Recent Meta-Analyses , 2013, PloS one.

[76]  L. Kraus,et al.  Are cannabis prevalence estimates comparable across countries and regions? A cross-cultural validation using search engine query data. , 2013, The International journal on drug policy.

[77]  Bin Nan,et al.  Gauging Interest of the General Public in Laser-Assisted In Situ Keratomileusis Eye Surgery , 2013, Cornea.

[78]  Ayers,et al.  Digital Detection for tobacco Control: Online reactions to the United states’ 2009 Cigarette excise tax increase , 2013 .

[79]  James A Gillespie,et al.  Internet Search Patterns of Human Immunodeficiency Virus and the Digital Divide in the Russian Federation: Infoveillance Study , 2013, Journal of medical Internet research.

[80]  Brian A. Nosek,et al.  Recommendations for Increasing Replicability in Psychology † , 2013 .

[81]  Thomas Braun,et al.  Medical nowcasting using Google trends: application in otolaryngology , 2013, European Archives of Oto-Rhino-Laryngology.

[82]  D. Lazer,et al.  The Parable of Google Flu: Traps in Big Data Analysis , 2014, Science.

[83]  Eugen Trinka,et al.  Why do people Google epilepsy? An infodemiological study of online behavior for epilepsy-related search terms , 2014, Epilepsy & Behavior.

[84]  K. Ribisl,et al.  Digital detection for tobacco control: online reactions to the 2009 U.S. cigarette excise tax increase. , 2013, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[85]  Geographic obesity burden and Internet searches for bariatric surgery: importance of a combined search strategy. , 2014, Surgery for obesity and related diseases : official journal of the American Society for Bariatric Surgery.

[86]  S. Mehta,et al.  A comparison of Internet search trends and sexually transmitted infection rates using Google trends. , 2014, Sexually transmitted diseases.

[87]  J Eric Schmitt,et al.  Know your market: use of online query tools to quantify trends in patient information-seeking behavior for varicose vein treatment. , 2013, Journal of vascular and interventional radiology : JVIR.

[88]  Juyoung Song,et al.  Psychological and Social Factors Affecting Internet Searches on Suicide in Korea: A Big Data Analysis of Google Search Trends , 2013, Yonsei medical journal.

[89]  Seth M Noar,et al.  Do celebrity cancer diagnoses promote primary cancer prevention? , 2014, Preventive medicine.