Making Mobile Browser Surveys Smarter

With nearly 50% of U.S. mobile phone subscribers using smartphones, survey researchers are beginning to explore their use as a data collection tool. The Got Healthy Apps Study (GHAS) conducted a randomized experiment to compare mode effects for a survey completed via iPhone mobile browser and online via desktop/laptop computer web browser. Mode effects were assessed for three types of outcomes: randomization/recruitment, survey process/completion, and survey items. In short, the distribution of survey completion times and the distribution of the number of apps owned were significantly different across survey mode after accounting for block group. Other key mode effects outcomes (including open-ended items, slider bar questions, and missing item rates) showed no significant differences across survey mode. Some interesting qualitative findings suggest that iPhone respondents enter more characters and omit fewer items than originally thought.

[1]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[2]  David A. Aaker,et al.  Statistical design for research , 1988 .

[3]  Lee Rainie,et al.  The Rise of E-Reading. , 2012 .

[4]  B. Duffy,et al.  Comparing Data from Online and Face-to-face Surveys , 2005 .

[5]  Shannon K. Gilmartin,et al.  Assessing Response Rates and Nonresponse Bias in Web and Paper Surveys , 2003 .

[6]  F. Conrad,et al.  Visual context effects in web surveys , 2007 .

[7]  Grinell Smith.  Does Gender Influence Online Survey Participation? A Record-Linkage Analysis of University Faculty Online Survey Response Behavior. , 2008 .

[8]  K. Lin.  Aspirin for the prevention of cardiovascular disease. , 2011, American family physician.

[9]  Mario Callegaro,et al.  Using Text Messages in U.S. Mobile Phone Surveys , 2007 .

[10]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[11]  E. Lehmann,et al.  Nonparametrics: Statistical Methods Based on Ranks , 1976 .

[12]  George Buchanan,et al.  Improving Web Interaction on Small Displays , 1999, Comput. Networks.

[13]  Andy Peytchev,et al.  Experiments in Mobile Web Survey Design , 2010 .

[14]  Alex Dmitrienko,et al.  Analysis of Clinical Trials Using SAS: A Practical Guide , 2005 .

[15]  J. Michael Brick,et al.  Cell Phone Survey Feasibility in The U.S.: Sampling and Calling Cell Numbers Versus Landline Numbers , 2007 .

[16]  Fabio Crestani,et al.  Effective search results summary size and device screen size: Is there a relationship? , 2005, Inf. Process. Manag..

[17]  Mario Callegaro.  Do You Know Which Device Your Respondent Has Used to Take Your Online Survey , 2010 .

[18]  Joanne R. Nurss,et al.  Diabetes in Urban African Americans: Functional Health Literacy of Municipal Hospital Outpatients With Diabetes , 1997, The Diabetes educator.

[19]  Nina S. Parikh,et al.  Inadequate functional health literacy among patients at two public hospitals. , 1995, JAMA.

[20]  Michael Bosnjak,et al.  Understanding the Willingness to Participate in Mobile Surveys: Exploring the Role of Utilitarian, Affective, Hedonic, Social, Self-Expressive, and Trust-Related Factors , 2010 .

[21]  Leslie Kish,et al.  Statistical Design for Research: Kish/Statistical Design for Research , 2005 .

[22]  Avi Parush,et al.  Web navigation structures in cellular phones: the depth/breadth trade-off issue , 2004, Int. J. Hum. Comput. Stud..