Why Do Web Surveys Take Longer on Smartphones?

Surveys completed on mobile web devices (smartphones) have been found to take longer than surveys completed on a PC. This has been found both in surveys where respondents can choose which device they use and in surveys where respondents are randomly assigned to devices. A number of potential explanations have been offered for these findings, including (1) slower transmission over cellular or Wi-Fi networks, (2) the difficulty of reading questions and selecting responses on a small device, and (3) the increased mobility of mobile web users who have more distractions while answering web surveys. In a secondary analysis of student surveys, we find that only about one-fifth of the time difference can be accounted for by transmission time (between-page time) with the balance being within-page time differences. Using multilevel models, we explore possible page-level (question-level) and respondent-level factors that may contribute to the time difference. We find that much of the time difference can be accounted for by the additional scrolling required on mobile devices, especially for grid questions.

[1]  Aigul Mavletova,et al.  Data Quality in PC and Mobile Web Surveys , 2013 .

[2]  Joanne Mechling,et al.  SOLVING THE UNINTENTIONAL MOBILE CHALLENGE , 2013 .

[3]  Dirk Heerwegh,et al.  Explaining Response Latencies and Changing Answers Using Client-Side Paradata from a Web Survey , 2003 .

[4]  William A. Cook.  Is Mobile a Reliable Platform For Survey Taking? , 2014, Journal of Advertising Research.

[5]  Trent D. Buskirk,et al.  Smart Surveys for Smart Phones: Exploring Various Approaches for Conducting Online Mobile Surveys via Smartphones* , 2012 .

[6]  Alice Hall,et al.  What's going on? Age, distraction, and multitasking during online survey taking , 2014, Comput. Hum. Behav..

[7]  Dirk Heerwegh.  Internet Survey Paradata , 2018, Social and Behavioral Research and the Internet.

[8]  Marika de Bruijne,et al.  Comparing Survey Results Obtained via Mobile Devices and Computers , 2013 .

[9]  Vera Toepoel,et al.  What Happens if You Offer a Mobile Option to Your Web Panel? Evidence From a Probability-Based Panel of Internet Users , 2014 .

[10]  Shengchao Yu,et al.  Gridlocked: The Impact of Adapting Survey Grids for Smartphones , 2016 .

[11]  Angie L. Miller,et al.  Living with Smartphones: Does Completion Device Affect Survey Responses? , 2015 .

[12]  Vera Toepoel,et al.  The Use of PCs, Smartphones, and Tablets in a Probability-Based Panel Survey , 2016 .

[13]  Lars Kaczmirek,et al.  Human-Survey Interaction : Usability and Nonresponse in Online Surveys , 2008 .

[14]  Mick P. Couper,et al.  Effects of Mobile versus PC Web on Survey Response Quality , 2017 .

[15]  R. Tourangeau,et al.  Fast times and easy questions: the effects of age, experience and question complexity on web survey response times , 2008 .

[16]  Tobias Gummer,et al.  Explaining Interview Duration in Web Surveys , 2015 .

[17]  Olena Kaminska,et al.  The Impact of Mobile Phones on Survey Measurement Error , 2013 .

[18]  Xiaolin Wang,et al.  What Is The Impact of Smartphone Optimization on Long Surveys , 2015 .

[19]  F. Al-Shamali,et al.  Author Biographies. , 2015, Journal of social work in disability & rehabilitation.

[20]  Marika de Bruijne,et al.  Mobile Response in Web Panels , 2014 .

[21]  Mick P. Couper,et al.  Sensitive Topics in PC Web and Mobile Web Surveys: Is There a Difference? , 2013 .

[22]  Mick P. Couper,et al.  Mobile Web Survey Design: Scrolling versus Paging, SMS versus E-mail Invitations , 2014 .

[23]  Frauke Kreuter,et al.  Using paradata to explore item level response times in surveys , 2013 .

[24]  Michael W. Link,et al.  Comparison of Smartphone and Online Computer Survey Administration , 2014 .

[25]  Ronald P. Carver,et al.  Reading Rate: Theory, Research, and Practical Implications. , 1992 .