A comparison of smartphone and paper data-collection tools in the Burden of Obstructive Lung Disease (BOLD) study in Gezira state, Sudan

Introduction Data collection using paper-based questionnaires can be time consuming and return errors affect data accuracy, completeness, and information quality in health surveys. We compared smartphone and paper-based data collection systems in the Burden of Obstructive Lung Disease (BOLD) study in rural Sudan. Methods This exploratory pilot study was designed to run in parallel with the cross-sectional household survey. The Open Data Kit was used to programme questionnaires in Arabic into smartphones. We included 100 study participants (83% women; median age = 41.5 ± 16.4 years) from the BOLD study from 3 rural villages in East-Gezira and Kamleen localities of Gezira state, Sudan. Questionnaire data were collected using smartphone and paper-based technologies simultaneously. We used Kappa statistics and inter-rater class coefficient to test agreement between the two methods. Results Symptoms reported included cough (24%), phlegm (15%), wheezing (17%), and shortness of breath (18%). One in five were or had been cigarette smokers. The two data collection methods varied between perfect to slight agreement across the 204 variables evaluated (Kappa varied between 1.00 and 0.02 and inter-rater coefficient between 1.00 and -0.12). Errors were most commonly seen with paper questionnaires (83% of errors seen) vs smartphones (17% of errors seen) administered questionnaires with questions with complex skip-patterns being a major source of errors in paper questionnaires. Automated checks and validations in smartphone-administered questionnaires avoided skip-pattern related errors. Incomplete and inconsistent records were more likely seen on paper questionnaires. Conclusion Compared to paper-based data collection, smartphone technology worked well for data collection in the study, which was conducted in a challenging rural environment in Sudan. This approach provided timely, quality data with fewer errors and inconsistencies compared to paper-based data collection. We recommend this method for future BOLD studies and other population-based studies in similar settings.

[1]  Shashank Garg,et al.  Electronic data capture for health surveys in developing countries: use of a mobile phone based application in southern India , 2013 .

[2]  Abhijit Pakhare,et al.  Use of mobile phones as research instrument for data collection. , 2013 .

[3]  Bryan A Weber,et al.  A comparison study: paper-based versus web-based data collection and management. , 2005, Applied nursing research : ANR.

[4]  Joy Buolamwini,et al.  A Novel Electronic Data Collection System for Large-Scale Surveys of Neglected Tropical Diseases , 2013, PloS one.

[5]  H. Lawin,et al.  Survey of airflow obstruction in two African countries: paper questionnaire versus mobile phone technology , 2013 .

[6]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[7]  Gaetano Borriello,et al.  Open data kit 2.0: expanding and refining information services for developing regions , 2013, HotMobile '13.

[8]  Geoffrey O. Arunga,et al.  A comparison of smartphones to paper-based questionnaires for routine influenza sentinel surveillance, Kenya, 2011–2012 , 2014, BMC Medical Informatics and Decision Making.

[9]  Ping Yu,et al.  The development and evaluation of a PDA-based method for public health surveillance data collection in developing countries , 2009, Int. J. Medical Informatics.

[10]  Benedikt Ley,et al.  Replacing paper data collection forms with electronic data entry in the field: findings from a study of community-acquired bloodstream infections in Pemba, Zanzibar , 2012, BMC Research Notes.

[11]  Manjinder S. Sandhu,et al.  Open-source electronic data capture system offered increased accuracy and cost-effectiveness compared with paper methods in Africa , 2014, Journal of clinical epidemiology.

[12]  Mark Tomlinson,et al.  The use of mobile phones as a data collection tool: A report from a household survey in South Africa , 2009, BMC Medical Informatics Decis. Mak..

[13]  Corinne Alberti,et al.  Comparison of two data collection processes in clinical studies: electronic and paper case report forms , 2014, BMC Medical Research Methodology.

[14]  Christian Schuster,et al.  Cutting costs, boosting quality and collecting data real-time - lessons from a cell phone-based beneficiary survey to strengthen Guatemala's conditional cash transfer program , 2011 .

[15]  Jon Bird,et al.  Electronic data capture in a rural African setting: evaluating experiences with different systems in Malawi , 2014, Global health action.