Comparing Twitter and Online Panels for Survey Recruitment of E-Cigarette Users and Smokers

Background E-cigarettes have rapidly increased in popularity in recent years, driven, at least in part, by marketing and word-of-mouth discussion on Twitter. Given the rapid proliferation of e-cigarettes, researchers need timely quantitative data from e-cigarette users and smokers who may see e-cigarettes as a cessation tool. Twitter provides an ideal platform for recruiting e-cigarette users and smokers who use Twitter. Online panels offer a second method of accessing this population, but they have been criticized for recruiting too few young adults, among whom e-cigarette use rates are highest. Objective This study compares effectiveness of recruiting Twitter users who are e-cigarette users and smokers who have never used e-cigarettes via Twitter to online panelists provided by Qualtrics and explores how users recruited differ by demographics, e-cigarette use, and social media use. Methods Participants were adults who had ever used e-cigarettes (n=278; male: 57.6%, 160/278; age: mean 34.26, SD 14.16 years) and smokers (n=102; male: 38.2%, 39/102; age: mean 42.80, SD 14.16 years) with public Twitter profiles. Participants were recruited via online panel (n=190) or promoted tweets using keyword targeting for e-cigarette users (n=190). Predictor variables were demographics (age, gender, education, race/ethnicity), e-cigarette use (eg, past 30-day e-cigarette use, e-cigarette puffs per day), social media use behaviors (eg, Twitter use frequency), and days to final survey completion from survey launch for Twitter versus panel. Recruitment method (Twitter, panel) was the dependent variable. Results Across the total sample, participants were recruited more quickly via Twitter (incidence rate ratio=1.30, P=.02) than panel. Compared with young adult e-cigarette users (age 18-24 years), e-cigarette users aged 25 to 34 years (OR 0.01, 95% CI 0.00-0.60, P=.03) and 35 to 44 years (OR 0.01, 95% CI 0.00-0.51, P=.02) were more likely to be recruited via Twitter than panel. Smokers aged 35 to 44 years were less likely than those aged 18 to 24 years to be recruited via Twitter than panel (35-44: OR 0.03, 95% CI 0.00-0.49, P=.01). E-cigarette users who reported a greater number of e-cigarette puffs per day were more likely to be recruited via Twitter than panel compared to those who reported fewer puffs per day (OR 1.12, 95% CI 1.05-1.20, P=.001). With each one-unit increase in Twitter usage, e-cigarette users were 9.55 times (95% CI 2.28-40.00, P=.002) and smokers were 4.91 times (95% CI 1.90-12.74, P=.001) as likely to be recruited via Twitter than panel. Conclusions Twitter ads were more time efficient than an online panel in recruiting e-cigarette users and smokers. In addition, Twitter provided access to younger adults, who were heavier users of e-cigarettes and Twitter. Recruiting via social media and online panel in combination offered access to a more diverse population of participants.

[1]  J. Byles,et al.  Online and Offline Recruitment of Young Women for a Longitudinal Health Survey: Findings From the Australian Longitudinal Study on Women’s Health 1989-95 Cohort , 2015, Journal of medical Internet research.

[2]  Patrick Gage Kelley,et al.  IWantPrivacy : Widespread Violation of Privacy Settings in the Twitter Social Network , 2010 .

[3]  Krista Casler,et al.  Separate but equal? A comparison of participants and data gathered via Amazon's MTurk, social media, and face-to-face behavioral testing , 2013, Comput. Hum. Behav..

[4]  Amanda Roberts,et al.  'Vaping' profiles and preferences: an online survey of electronic cigarette users. , 2013, Addiction.

[5]  S. Emery,et al.  A cross-sectional examination of marketing of electronic cigarettes on Twitter , 2014, Tobacco Control.

[6]  Ron Borland,et al.  Electronic Nicotine Delivery System , 2015 .

[7]  J. Ostroff,et al.  Electronic cigarette use among patients with cancer: Characteristics of electronic cigarette users and their smoking cessation outcomes , 2014, Cancer.

[8]  J. Prochaska,et al.  Recruitment of adolescents for a smoking study: use of traditional strategies and social media , 2015, Translational behavioral medicine.

[9]  S. Michie,et al.  Real-world effectiveness of e-cigarettes when used to aid smoking cessation: a cross-sectional population study , 2014, BDJ.

[10]  V. Freimuth,et al.  Is there a hard-to-reach audience? , 1990, Public health reports.

[11]  Sarah E. Adkison,et al.  Electronic nicotine delivery systems: international tobacco control four-country survey. , 2013, American journal of preventive medicine.

[12]  Annice E Kim,et al.  Using Twitter Data to Gain Insights into E-cigarette Marketing and Locations of Use: An Infoveillance Study , 2015, Journal of medical Internet research.

[13]  Ralph W Hingson,et al.  A comparison of results from an alcohol survey of a prerecruited Internet panel and the National Epidemiologic Survey on Alcohol and Related Conditions. , 2008, Alcoholism, clinical and experimental research.

[14]  Mallory O. Johnson,et al.  Using Online Social Media for Recruitment of Human Immunodeficiency Virus-Positive Participants: A Cross-Sectional Survey , 2014, Journal of medical Internet research.

[15]  Danielle E. Ramo,et al.  Broad Reach and Targeted Recruitment Using Facebook for an Online Survey of Young Adult Substance Use , 2012, Journal of medical Internet research.

[16]  C. Schoenborn,et al.  Electronic Cigarette Use Among Adults: United States, 2014. , 2015, NCHS data brief.

[17]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[18]  M. Goniewicz,et al.  Patterns of electronic cigarette use and user beliefs about their safety and benefits: an internet survey. , 2013, Drug and alcohol review.

[19]  N. Titov,et al.  Facebook as an effective recruitment strategy for mental health research of hard to reach populations , 2016, Internet interventions.

[20]  J. Etter,et al.  Electronic cigarette: users profile, utilization, satisfaction and perceived efficacy. , 2011, Addiction.

[21]  Sonya A. Grier,et al.  Social marketing in public health. , 2005, Annual review of public health.

[22]  Danielle E. Ramo,et al.  Facebook Recruitment of Young Adult Smokers for a Cessation Trial: Methods, Metrics, and Lessons Learned. , 2014, Internet interventions.

[23]  Jonathan D Klein,et al.  Trends in Electronic Cigarette Use Among U.S. Adults: Use is Increasing in Both Smokers and Nonsmokers. , 2015, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[24]  Brian A. King,et al.  Tobacco Product Use Among Adults — United States, 2015 , 2017, MMWR. Morbidity and mortality weekly report.

[25]  Brian A. King,et al.  Current cigarette smoking among adults - United States, 2005-2014. , 2015, MMWR. Morbidity and mortality weekly report.

[26]  Jennifer L. Pearson,et al.  e-Cigarette awareness, use, and harm perceptions in US adults. , 2012, American journal of public health.

[27]  K. Kypri,et al.  Social Networking Versus Facebook Advertising to Recruit Survey Respondents: A Quasi-Experimental Study , 2014, JMIR research protocols.

[28]  Brian A. King,et al.  Current Cigarette Smoking Among Adults — United States, 2016 , 2015, MMWR. Morbidity and mortality weekly report.

[29]  Brian A. King,et al.  Tobacco Product Use Among Adults - United States, 2013-2014. , 2016, MMWR. Morbidity and mortality weekly report.

[30]  L. Biener,et al.  A longitudinal study of electronic cigarette use among a population-based sample of adult smokers: association with smoking cessation and motivation to quit. , 2015, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.