Text Messaging Data Collection for Monitoring an Infant Feeding Intervention Program in Rural China: Feasibility Study

Background An effective data collection method is crucial for high quality monitoring of health interventions. The traditional face-to-face data collection method is labor intensive, expensive, and time consuming. With the rapid increase of mobile phone subscribers, text messaging has the potential to be used for evaluation of population health interventions in rural China. Objective The objective of this study was to explore the feasibility of using text messaging as a data collection tool to monitor an infant feeding intervention program. Methods Participants were caregivers of children aged 0 to 23 months in rural China who participated in an infant feeding health education program. We used the test-retest method. First, we collected data with a text messaging survey and then with a face-to-face survey for 2 periods of 3 days. We compared the response rate, data agreement, costs, and participants’ acceptability of the two methods. Also, we interviewed participants to explore their reasons for not responding to the text messages and the reasons for disagreement in the two methods. In addition, we evaluated the most appropriate time during the day for sending text messages. Results We included 258 participants; 99 (38.4%) participated in the text messaging survey and 177 (68.6%) in the face-to-face survey. Compared with the face-to-face survey, the text messaging survey had much lower response rates to at least one question (38.4% vs 68.6%) and to all 7 questions (27.9% vs 67.4%) with moderate data agreement (most kappa values between .5 and .75, the intraclass correlation coefficients between .53 to .72). Participants who took part in both surveys gave the same acceptability rating for both methods (median 4.0 for both on a 5-point scale, 1=disliked very much and 5=liked very much). The costs per questionnaire for the text messaging method were much lower than the costs for the face-to-face method: ¥19.7 (US $3.13) versus ¥33.9 (US $5.39) for all questionnaires, and ¥27.1 (US $4.31) versus ¥34.4 (US $5.47) for completed questionnaires. The main reasons for not replying were that participants did not receive text messages, they were too busy to reply, or they did not see text messages in time. The main reasons for disagreement in responses were that participants forgot their answers in the text messaging survey and that they changed their minds. We found that participants were more likely to reply to text messages immediately during 2 time periods: 8 AM to 3 PM and 8 PM to 9 PM. Conclusions The text messaging method had reasonable data agreement and low cost, but a low response rate. Further research is needed to evaluate effectiveness of measures that can increase the response rate, especially in collecting longitudinal data by text messaging.

[1]  Josip Car,et al.  mHealth Series: mHealth project in Zhao County, rural China – Description of objectives, field site and methods , 2013, Journal of global health.

[2]  R. Martorell,et al.  Maternal and child undernutrition and overweight in low-income and middle-income countries , 2013, The Lancet.

[3]  Josip Car,et al.  Improving the intake of nutritious food in children aged 6-23 months in Wuyi County, China – a multi-method approach , 2013, Croatian medical journal.

[4]  R. Herbert,et al.  Feasibility of short message service to document bleeding episodes in children with haemophilia , 2012, Haemophilia : the official journal of the World Federation of Hemophilia.

[5]  J. McGuinness,et al.  Post‐tonsillectomy pain in 24 children – utilising short message service (SMS) to assess postoperative outcomes , 2012, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.

[6]  J. Car,et al.  Smartphone Versus Pen-and-Paper Data Collection of Infant Feeding Practices in Rural China , 2012, Journal of medical Internet research.

[7]  Jeremy C. Wyatt,et al.  Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project , 2012, J. Am. Medical Informatics Assoc..

[8]  Emmanuel Kuntsche,et al.  Investigating the drinking patterns of young people over the course of the evening at weekends. , 2012, Drug and alcohol dependence.

[9]  Lennart Bodin,et al.  Analyzing repeated data collected by mobile phones and frequent text messages. An example of Low back pain measured weekly for 18 weeks , 2012, BMC Medical Research Methodology.

[10]  Jane Latimer,et al.  Feasibility of Using Short Message Service to Collect Pain Outcomes in a Low Back Pain Clinical Trial , 2012, Spine.

[11]  Niels Wedderkopp,et al.  Injury risk in Danish youth and senior elite handball using a new SMS text messages approach , 2012, British Journal of Sports Medicine.

[12]  D. Hipgrave Perspectives on the progress of China’s 2009 – 2012 health system reform , 2011, Journal of global health.

[13]  D. Hipgrave Communicable disease control in China: From Mao to now , 2011, Journal of global health.

[14]  Lars E. Lyberg,et al.  Data Collection Methods and Measurement Error: An Overview , 2011 .

[15]  Susan M. Schembre,et al.  Project TwEATs. A feasibility study testing the use of automated text messaging to monitor appetite ratings in a free-living population , 2011, Appetite.

[16]  ST Kew,et al.  Text messaging: an innovative method of data collection in medical research , 2010, BMC Research Notes.

[17]  Ira B. Wilson,et al.  Challenges in Using Mobile Phones for Collection of Antiretroviral Therapy Adherence Data in a Resource-Limited Setting , 2010, AIDS and Behavior.

[18]  Niels Wedderkopp,et al.  Comparison between data obtained through real-time data capture by SMS and a retrospective telephone interview , 2010, Chiropractic & osteopathy.

[19]  G. Goodwin,et al.  The longitudinal course of bipolar disorder as revealed through weekly text messaging: a feasibility study. , 2010, Bipolar disorders.

[20]  K. Eyrich-Garg Mobile Phone Technology: A New Paradigm for the Prevention, Treatment, and Research of the Non-sheltered “Street” Homeless? , 2010, Journal of Urban Health.

[21]  J. Maher,et al.  Using text messaging to contact difficult-to-reach study participants. , 2010, American journal of public health.

[22]  David Cella,et al.  Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good Research Practices Task Force report. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[23]  A Roberts,et al.  Short message service for outpatient data collection. , 2009, British journal of anaesthesia.

[24]  Yufei Yuan,et al.  Would people pay for text messaging health reminders? , 2008, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[25]  Karin Leder,et al.  BMC Medical Research Methodology BioMed Central , 2008 .

[26]  Nina Østerås,et al.  A randomised comparison of a four- and a five-point scale version of the Norwegian Function Assessment Scale , 2008, Health and quality of life outcomes.

[27]  P. Chisnall Mail and Internet Surveys: The Tailored Design Method , 2007, Journal of Advertising Research.

[28]  J. Michael Brick,et al.  Cell Phone Survey Feasibility in The U.S.: Sampling and Calling Cell Numbers Versus Landline Numbers , 2007 .

[29]  E. Roberts Caroline,et al.  Mixing modes of data collection in surveys: A methodological review , 2007 .

[30]  J. Anhøj,et al.  Feasibility of Collecting Diary Data From Asthma Patients Through Mobile Phones and SMS (Short Message Service): Response Rate Analysis and Focus Group Evaluation From a Pilot Study , 2004, Journal of medical Internet research.

[31]  Tom W. Smith,et al.  ASKING SENSITIVE QUESTIONS THE IMPACT OF DATA COLLECTION MODE, QUESTION FORMAT, AND QUESTION CONTEXT , 1996 .

[32]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[33]  A. Hrõbjartsson,et al.  Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. , 2011, Journal of clinical epidemiology.

[34]  Jan-Eric Litton,et al.  SMS versus telephone interviews for epidemiological data collection: feasibility study estimating influenza vaccination coverage in the Swedish population , 2008, European Journal of Epidemiology.

[35]  H. Weisberg The Total Survey Error Approach: A Guide to the New Science of Survey Research , 2005 .

[36]  D. Leeuw,et al.  Data Quality in Mail, Telephone and Face to Face Surveys. , 1992 .

[37]  Classics in the History of Psychology The Myth of Mental Illness , 2022 .