Accuracy of Geographically Targeted Internet Advertisements on Google Adwords for Recruitment in a Randomized Trial

Background Google AdWords are increasingly used to recruit people into research studies and clinical services. They offer the potential to recruit from targeted control areas in cluster randomized controlled trials (RCTs), but little is known about the feasibility of accurately targeting ads by location and comparing with control areas. Objective To examine the accuracy and contamination of control areas by a location-targeted online intervention using Google AdWords in a pilot cluster RCT. Methods Based on previous use of online cognitive behavioral therapy for depression and population size, we purposively selected 16 of the 121 British postcode areas and randomized them to three intervention and one (do-nothing) control arms. Two intervention arms included use of location-targeted AdWords, and we compared these with the do-nothing control arm. We did not raise the visibility of our research website to normal Web searches. Users who clicked on the ad were directed to our project website, which collected the computer Internet protocol (IP) address, date, and time. Visitors were asked for their postcode area and to complete the Patient Health Questionnaire (depression). They were then offered links to several online depression resources. Google Analytics largely uses IP methods to estimate location, but AdWords uses additional information. We compared locations assessed by (1) Analytics, and (2) as self-identified by users. Results Ads were shown 300,523 times with 4207 click-throughs. There were few site visits except through AdWord click-throughs. Both methods of location assessment agreed there was little contamination of control areas. According to Analytics, 69.75% (2617/3752) of participants were in intervention areas, only 0% (8/3752) in control areas, but 30.04% (1127/3752) in other areas. However, according to user-stated postcodes, only 20.7% (463/2237) were in intervention areas, 1% (22/2236) in control areas, but 78.31% (1751/2236) in other areas. Both location assessments suggested most leakage from the intervention arms was to nearby postcode areas. Analytics data differed from postcodes reported by participants. Analysis of a subset of 200/2236 records over 10 days comparing IP-estimated location with stated postcode suggested that Google AdWords targeted correctly in just half the cases. Analytics agreed with our assessment that, overall, one-third were wrongly targeted by AdWords. There appeared little evidence that people who bothered to give their postcode did not answer truthfully. Conclusions Although there is likely to be substantial leakage from the targeted areas, if intervention and control areas are a sufficient distance apart, it is feasible to conduct a cluster RCT using online ads to target British postcode areas without significant contamination. Trial Registration Clinicaltrials.gov NCT01469689; http://clinicaltrials.gov/ct2/show/NCT01469689 (Archived by WebCite at http://www.webcitation.org/681iro5OU)

[1]  R. Muñoz,et al.  ARE CONSUMERS OF INTERNET HEALTH INFORMATION “CYBERCHONDRIACS”? CHARACTERISTICS OF 24,965 USERS OF A DEPRESSION SCREENING SITE , 2012, Depression and anxiety.

[2]  Nathan K. Cobb,et al.  Characteristics of smokers reached and recruited to an internet smoking cessation trial: a case of denominators. , 2006, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[3]  David J Torgerson,et al.  Contamination in trials: is cluster randomisation the answer? , 2001, BMJ : British Medical Journal.

[4]  Maged N Kamel Boulos,et al.  Location-based health information services: a new paradigm in personalised information delivery , 2003, International journal of health geographics.

[5]  F. Song,et al.  Contamination in trials of educational interventions. , 2007, Health technology assessment.

[6]  R. Spitzer,et al.  The PHQ-9: A new depression diagnostic and severity measure , 2002 .

[7]  Steve Wheeler,et al.  How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX , 2011, Biomedical engineering online.

[8]  M. Cowen,et al.  The impact of a celebrity promotional campaign on the use of colon cancer screening: the Katie Couric effect. , 2003, Archives of internal medicine.

[9]  H. Christensen,et al.  Delivering interventions for depression by using the internet: randomised controlled trial , 2004, BMJ : British Medical Journal.

[10]  P. Bower,et al.  Collaborative care for depression in UK primary care: a randomized controlled trial , 2007, Psychological Medicine.

[11]  Christopher Rhoads.  The Implications of “Contamination” for Experimental Design in Education , 2011 .

[12]  Ray B. Jones,et al.  Phase 1 pilot study of e-mail support for people with long term conditions using the Internet , 2011, BMC Medical Informatics Decis. Mak..

[13]  Ray B. Jones,et al.  Costs and difficulties of recruiting patients to provide e-health support: pilot study in one primary care trust , 2012, BMC Medical Informatics and Decision Making.

[14]  George Hripcsak,et al.  Review Paper: Design and Analysis of Controlled Trials in Naturally Clustered Environments: Implications for Medical Informatics , 2002, J. Am. Medical Informatics Assoc..

[15]  S. Boles,et al.  Successful participant recruitment strategies for an online smokeless tobacco cessation program. , 2006, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[16]  C. Purdy,et al.  Using the Internet and social media to promote condom use in Turkey , 2011, Reproductive health matters.

[17]  M. Bachmann,et al.  Expert consensus on contamination in educational trials elicited by a Delphi exercise , 2007, Medical Education.

[18]  Heleen Riper,et al.  Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis , 2006, Psychological Medicine.

[19]  Amanda L. Graham,et al.  Online Advertising as a Public Health and Recruitment Tool: Comparison of Different Media Campaigns to Increase Demand for Smoking Cessation Interventions , 2008, Journal of medical Internet research.

[20]  E. Maibach,et al.  The role of media across four levels of health promotion intervention. , 1989, Annual review of public health.

[21]  V. Owen-Smith,et al.  The impact of a television soap opera on the NHS Cervical Screening Programme in the North West of England. , 2002, Journal of public health medicine.