Increasing the response rate of text messaging data collection: a delayed randomized controlled trial

OBJECTIVE To test the effectiveness of multiple interventions on increasing the response rate of text messaging for longitudinal data collection. METHODS Our cohort included 283 caregivers of children aged 6-12 months who were participating in an anemia program in rural China. Using text messages to collect data on anemia medication adherence, we conducted a delayed randomized controlled trial to test multiple interventions (an additional four reminders; a ¥5.0 (US$0.79) credit reward for replying; and a feedback text message). After a 6-week pilot study with week 7 as the baseline measurement, we randomly allocated all participants into two groups: group 1 (n = 142) and group 2 (n = 141). During weeks 8-11, we introduced the interventions to group 1, and in weeks 12-15 the intervention was introduced to both groups. We compared the response rates between groups and explored factors affecting the response rate. RESULTS During weeks 8-11, the response rates in group 1 increased and were significantly higher than in group 2 (p<0.05). During weeks 12-15, the response rate increased significantly in group 2 (p>0.05) and slightly decreased in group 1. Younger participants or participants who had children with lower hemoglobin concentration were more likely to reply (p = 0.02). Sending four reminders on the second day contributed to only 286 (11.7%) extra text messages. DISCUSSION Our study showed that multiple interventions were effective in increasing response rate of text messaging data collection in rural China. CONCLUSIONS Larger multi-site studies are needed to find the most effective way of using these interventions to allow usage of text messaging data collection for health research.

[1]  Emmanuel Kuntsche,et al.  Investigating the drinking patterns of young people over the course of the evening at weekends. , 2012, Drug and alcohol dependence.

[2]  Lennart Bodin,et al.  The use of weekly text messaging over 6 months was a feasible method for monitoring the clinical course of low back pain in patients seeking chiropractic care. , 2012, Journal of clinical epidemiology.

[3]  Jeremy C. Wyatt,et al.  Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project , 2012, J. Am. Medical Informatics Assoc..

[4]  Patricia Langenberg,et al.  A randomized trial of incentives to improve response rates to a mailed women's health questionnaire. , 2003, Journal of women's health.

[5]  K. Eyrich-Garg Mobile Phone Technology: A New Paradigm for the Prevention, Treatment, and Research of the Non-sheltered “Street” Homeless? , 2010, Journal of Urban Health.

[6]  Ira B. Wilson,et al.  Challenges in Using Mobile Phones for Collection of Antiretroviral Therapy Adherence Data in a Resource-Limited Setting , 2010, AIDS and Behavior.

[7]  J. Michael Brick,et al.  Cell Phone Survey Feasibility in The U.S.: Sampling and Calling Cell Numbers Versus Landline Numbers , 2007 .

[8]  J. Car,et al.  Smartphone Versus Pen-and-Paper Data Collection of Infant Feeding Practices in Rural China , 2012, Journal of medical Internet research.

[9]  Jan-Eric Litton,et al.  SMS versus telephone interviews for epidemiological data collection: feasibility study estimating influenza vaccination coverage in the Swedish population , 2008, European Journal of Epidemiology.

[10]  Karin Leder,et al.  BMC Medical Research Methodology BioMed Central , 2008 .

[11]  Niels Wedderkopp,et al.  Comparison between data obtained through real-time data capture by SMS and a retrospective telephone interview , 2010, Chiropractic & osteopathy.

[12]  T. Suppes,et al.  The longitudinal course of bipolar disorder. , 2000, The Journal of clinical psychiatry.

[13]  D A Asch,et al.  Response rates to mail surveys published in medical journals. , 1997, Journal of clinical epidemiology.

[14]  Jane Latimer,et al.  Feasibility of Using Short Message Service to Collect Pain Outcomes in a Low Back Pain Clinical Trial , 2012, Spine.

[15]  ST Kew,et al.  Text messaging: an innovative method of data collection in medical research , 2010, BMC Research Notes.

[16]  Lennart Bodin,et al.  Analyzing repeated data collected by mobile phones and frequent text messages. An example of Low back pain measured weekly for 18 weeks , 2012, BMC Medical Research Methodology.

[17]  J. Maher,et al.  Using text messaging to contact difficult-to-reach study participants. , 2010, American journal of public health.

[18]  Susan M. Schembre,et al.  Project TwEATs. A feasibility study testing the use of automated text messaging to monitor appetite ratings in a free-living population , 2011, Appetite.

[19]  R. Herbert,et al.  Feasibility of short message service to document bleeding episodes in children with haemophilia , 2012, Haemophilia : the official journal of the World Federation of Hemophilia.

[20]  Marie Löf,et al.  Estimating physical activity using a cell phone questionnaire sent by means of short message service (SMS): a randomized population-based study , 2012, European Journal of Epidemiology.

[21]  Niels Wedderkopp,et al.  Injury risk in Danish youth and senior elite handball using a new SMS text messages approach , 2012, British Journal of Sports Medicine.

[22]  A Roberts,et al.  Short message service for outpatient data collection. , 2009, British journal of anaesthesia.

[23]  Rachel Burman,et al.  Study protocol: delayed intervention randomised controlled trial within the Medical Research Council (MRC) Framework to assess the effectiveness of a new palliative care service , 2006, BMC Palliative Care.

[24]  M. Clarke,et al.  Methods to increase response to postal and electronic questionnaires , 2023, The Cochrane database of systematic reviews.

[25]  J. Anhøj,et al.  Feasibility of Collecting Diary Data From Asthma Patients Through Mobile Phones and SMS (Short Message Service): Response Rate Analysis and Focus Group Evaluation From a Pilot Study , 2004, Journal of medical Internet research.

[26]  G. Goodwin,et al.  The longitudinal course of bipolar disorder as revealed through weekly text messaging: a feasibility study. , 2010, Bipolar disorders.

[27]  E. Kuntsche,et al.  Short message service (SMS) technology in alcohol research--a feasibility study. , 2009, Alcohol and alcoholism.

[28]  J. Car,et al.  Text Messaging Data Collection for Monitoring an Infant Feeding Intervention Program in Rural China: Feasibility Study , 2013, Journal of medical Internet research.

[29]  Josip Car,et al.  Improving the intake of nutritious food in children aged 6-23 months in Wuyi County, China – a multi-method approach , 2013, Croatian medical journal.

[30]  J. Olsen,et al.  Improving response rate and quality of survey data with a scratch lottery ticket incentive , 2012, BMC Medical Research Methodology.

[31]  V. Gqamane The Millennium Development Goals Report, 2009 , 2009 .