mHealth Series: Factors influencing sample size calculations for mHealth–based studies – A mixed methods study in rural China

Background An important issue for mHealth evaluation is the lack of information for sample size calculations. Objective To explore factors that influence sample size calculations for mHealth–based studies and to suggest strategies for increasing the participation rate. Methods We explored factors influencing recruitment and follow–up of participants (caregivers of children) in an mHealth text messaging data collection cross–over study. With help of village doctors, we recruited 1026 (25%) caregivers of children under five out of the 4170 registered. To explore factors influencing recruitment and provide recommendations for improving recruitment, we conducted semi–structured interviews with village doctors. Of the 1014 included participants, 662 (65%) responded to the first question about willingness to participate, 538 (53%) responded to the first survey question and 356 (35%) completed the text message survey. To explore factors influencing follow–up and provide recommendations for improving follow–up, we conducted interviews with participants. We added views from the researchers who were involved in the study to contextualize the findings. Results We found several factors influencing recruitment related to the following themes: experiences with recruitment, village doctors’ work, village doctors’ motivations, caregivers’ characteristics, caregivers’ motivations. Village doctors gave several recommendations for ways to recruit more caregivers and we added our views to these. We found the following factors influencing follow–up: mobile phone usage, ability to use mobile phone, problems with mobile phone, checking mobile phone, available time, paying back text message costs, study incentives, subjective norm, culture, trust, perceived usefulness of process, perceived usefulness of outcome, perceived ease of use, attitude, behavioural intention to use, and actual use. From our perspective, factors influencing follow–up were: different caregivers participating in face–to–face and text message survey, sending text messages manually, participants responding incorrectly, and technical issues. Participants provided several recommendations for improving follow–up and we added our views to these. Conclusions This is the first study to evaluate factors influencing recruitment and follow–up of participants in an mHealth study in a middle–income setting. More work is needed to assess effectiveness of our suggested strategies. This work would improve evaluation of mHealth interventions.

[1]  D. Hipgrave Communicable disease control in China: From Mao to now , 2011, Journal of global health.

[2]  A Roberts,et al.  Short message service for outpatient data collection. , 2009, British journal of anaesthesia.

[3]  Jing Chen,et al.  Language and rigour in qualitative research: Problems and principles in analyzing data collected in Mandarin , 2008, BMC medical research methodology.

[4]  Josip Car,et al.  Improving the intake of nutritious food in children aged 6-23 months in Wuyi County, China – a multi-method approach , 2013, Croatian medical journal.

[5]  X. Liu,et al.  An Introduction to China's Health Care System , 1991, Journal of public health policy.

[6]  Josip Car,et al.  mHealth Series: Text messaging data collection of infant and young child feeding practice in rural China – a feasibility study , 2013, Journal of global health.

[7]  Linda Richter,et al.  Collecting Maternal Health Information From HIV-Positive Pregnant Women Using Mobile Phone-Assisted Face-to-Face Interviews in Southern Africa , 2013, Journal of medical Internet research.

[8]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[9]  J. Car,et al.  Smartphone Versus Pen-and-Paper Data Collection of Infant Feeding Practices in Rural China , 2012, Journal of medical Internet research.

[10]  Campbell K Aitken,et al.  Randomised controlled trial of paper, online and SMS diaries for collecting sexual behaviour information from young people , 2009, Journal of Epidemiology & Community Health.

[11]  Viswanath Venkatesh,et al.  Why Don't Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior , 2000, MIS Q..

[12]  Bronwyn K. Clark,et al.  Adults' past-day recall of sedentary time: reliability, validity, and responsiveness. , 2013, Medicine and science in sports and exercise.

[13]  Niels Wedderkopp,et al.  Comparison between data obtained through real-time data capture by SMS and a retrospective telephone interview , 2010, Chiropractic & osteopathy.

[14]  Sara T Brookes,et al.  A review of reporting of participant recruitment and retention in RCTs in six major journals , 2009, Trials.

[15]  ST Kew,et al.  Text messaging: an innovative method of data collection in medical research , 2010, BMC Research Notes.

[16]  Rebecca Schnall,et al.  Using Text Messaging to Assess Adolescents' Health Information Needs: An Ecological Momentary Assessment , 2013, Journal of medical Internet research.

[17]  M Sandelowski,et al.  Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. , 2000, Research in nursing & health.

[18]  M. Benzeval,et al.  A systematic review of the effect of retention methods in population-based cohort studies , 2011, BMC public health.

[19]  Lennart Bodin,et al.  The use of weekly text messaging over 6 months was a feasible method for monitoring the clinical course of low back pain in patients seeking chiropractic care. , 2012, Journal of clinical epidemiology.

[20]  David W Corpman Mobile Health in China: A Review of Research and Programs in Medical Care, Health Education, and Public Health , 2013, Journal of health communication.

[21]  J. Anhøj,et al.  Feasibility of Collecting Diary Data From Asthma Patients Through Mobile Phones and SMS (Short Message Service): Response Rate Analysis and Focus Group Evaluation From a Pilot Study , 2004, Journal of medical Internet research.

[22]  Hsiao-Yu Chen,et al.  Translation and back-translation in qualitative nursing research: methodological review. , 2010, Journal of clinical nursing.

[23]  Shaun Treweek,et al.  Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-analysis , 2013, BMJ Open.

[24]  E. Carr,et al.  The use of the telephone interview for research , 2001 .

[25]  K. King,et al.  The telephone interview is an effective method of data collection in clinical nursing research: a discussion paper. , 2007, International journal of nursing studies.

[26]  C. Mathers,et al.  Maternal and child undernutrition: global and regional exposures and health consequences , 2008, The Lancet.

[27]  Polun Chang,et al.  A Newborn Baby Care Support App and System for mHealth , 2012, Nursing Informatics.

[28]  K. Courtney,et al.  Exploring underutilization of videophones in hospice settings. , 2007, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[29]  J. Car,et al.  Text Messaging Data Collection for Monitoring an Infant Feeding Intervention Program in Rural China: Feasibility Study , 2013, Journal of medical Internet research.

[30]  F. Arnold,et al.  Measuring Coverage in MNCH: Tracking Progress in Health for Women and Children Using DHS and MICS Household Surveys , 2013, PLoS medicine.

[31]  Detmar W. Straub,et al.  Testing the technology acceptance model across cultures: A three country study , 1997, Inf. Manag..

[32]  M. Hadders‐Algra,et al.  How much loss to follow-up is acceptable in long-term randomised trials and prospective studies? , 2008, Archives of Disease in Childhood.

[33]  Cui Weiyuan,et al.  China's village doctors take great strides. , 2008, Bulletin of the World Health Organization.

[34]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[35]  Xiaojun Tang,et al.  Is the short messaging service feasible to improve adherence to tuberculosis care? A cross-sectional study. , 2013, Transactions of the Royal Society of Tropical Medicine and Hygiene.

[36]  Josip Car,et al.  mHealth Series: mHealth project in Zhao County, rural China – Description of objectives, field site and methods , 2013, Journal of global health.

[37]  Qiong Wu,et al.  A comparison between antenatal care quality in public and private sector in rural Hebei, China , 2013, Croatian medical journal.

[38]  Richard J. Holden,et al.  The Technology Acceptance Model: Its past and its future in health care , 2010, J. Biomed. Informatics.

[39]  Su-Chao Chang,et al.  An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry , 2008, Int. J. Medical Informatics.

[40]  M. Gagnon,et al.  Using a modified technology acceptance model to evaluate healthcare professionals' adoption of a new telemonitoring system. , 2012, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[41]  Niels Wedderkopp,et al.  Injury risk in Danish youth and senior elite handball using a new SMS text messages approach , 2012, British Journal of Sports Medicine.

[42]  Jon Nicholl,et al.  A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies , 2013, Trials.

[43]  Min-Huei Hsu,et al.  Factors influencing consumer adoption of USB-based Personal Health Records in Taiwan , 2012, BMC Health Services Research.

[44]  Lyndsay D. Hughes,et al.  Not 2 old 2 TXT: There is potential to use email and SMS text message healthcare reminders for rheumatology patients up to 65 years old , 2011, Health Informatics J..

[45]  Jan-Eric Litton,et al.  SMS versus telephone interviews for epidemiological data collection: feasibility study estimating influenza vaccination coverage in the Swedish population , 2008, European Journal of Epidemiology.

[46]  Jeremy C. Wyatt,et al.  Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project , 2012, J. Am. Medical Informatics Assoc..

[47]  Caroline O. Buckee,et al.  Heterogeneous Mobile Phone Ownership and Usage Patterns in Kenya , 2012, PloS one.

[48]  L. Swartz,et al.  Scaling Up mHealth: Where Is the Evidence? , 2013, PLoS medicine.

[49]  Henry Been-Lirn Duh,et al.  A study on Singaporean women's acceptance of using mobile phones to seek health information , 2011, Int. J. Medical Informatics.

[50]  Ira B. Wilson,et al.  Challenges in Using Mobile Phones for Collection of Antiretroviral Therapy Adherence Data in a Resource-Limited Setting , 2010, AIDS and Behavior.

[51]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[52]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[53]  Edward C. Jones,et al.  A comparison of two time intervals for test-retest reliability of health status instruments. , 2003, Journal of clinical epidemiology.

[54]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[55]  Susan M. Schembre,et al.  Project TwEATs. A feasibility study testing the use of automated text messaging to monitor appetite ratings in a free-living population , 2011, Appetite.

[56]  Josip Car,et al.  mHealth Series: Measuring maternal newborn and child health coverage by text messaging - a county-level model for China. , 2013, Journal of global health.