Online survey: A national study with school principals

Abstract School principals are busy people. From a government perspective they are also strategic stakeholders of information products and services, which government agencies deliver to school communities in order to achieve higher levels of quality and equity in education. In the context of user-centered ICT developments, public organizations find online surveys to be a reliable and cost effective means for gathering information on the needs and perceptions of its citizens. This study aims to understand the influence of email scheduling on the response rate and response time for an online survey, focusing on a representative sample of 1000 school principals at public and private schools in Chile. It also adds an exploratory inquiry (n = 100) into embedding a survey in an email, as opposed to sending it via a link. In line with previous research, the findings reveal the non-significant effect of weekday and daytime emails on response rate and response time. They also reveal that a reminder message can have a significant effect on response rate and that there was no difference in response rate between surveys embedded in an email and surveys sent via a link. Significant differences are found in the response rate and response time between urban and rural schools. The implications for bridging the information gap in online consultations are discussed.

[1]  Shelley Boulianne,et al.  Sponsor Prominence and Responses Patterns to an Online Survey. International Journal of Public Opinion Research Advance Access , 2010 .

[2]  Melanie Revilla,et al.  What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts Done? , 2015 .

[3]  Nikolai Sobotta,et al.  Measuring E-Mail Induced Information Overload from a Capacity Perspective: A Research Model and Pilot Test , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[4]  Georg Aichholzer,et al.  Collaborative Forms of Citizen (e-)Participation , 2016 .

[5]  L. Kanuk,et al.  Mail Surveys and Response Rates: A Literature Review , 1975 .

[6]  Daniel F. Perkins,et al.  Online Surveys: Increasing Your Research and Evaluation Capacity , 2006 .

[7]  Jason A. Grissom,et al.  Principal time management skills: Explaining patterns in principals’ time use, job stress, and perceived effectiveness , 2015 .

[8]  Thomas Porter,et al.  Investigating The Three-Click Rule: A Pilot Study , 2016 .

[9]  Luz Maria Garcia-Garcia,et al.  User Centric e-Government: the Modernization of the National Institute of Migration at Mexico's Southern Border , 2016, ICEGOV.

[10]  Morgaen L. Donaldson.  Principals' Approaches to Developing Teacher Quality: Constraints and Opportunities in Hiring, Assigning, Evaluating, and Developing Teachers. , 2011 .

[11]  Susan Rose-Ackerman,et al.  Corruption and Government: Causes, Consequences, and Reform , 1999 .

[12]  P. Vigneswara Ilavarasan,et al.  Determinants of e-participation in the citizens and the government initiatives: Insights from India , 2016 .

[13]  Kim M. Unertl,et al.  Usability: Making It Real from Concepts to Implementation and End-User Adoption , 2016 .

[14]  Adam N. Joinson,et al.  Personalized salutation, power of sender and response rates to Web-based surveys , 2007, Comput. Hum. Behav..

[15]  Pei-An Liao,et al.  What are the determinants of rural-urban digital inequality among schoolchildren in Taiwan? Insights from Blinder-Oaxaca decomposition , 2016, Comput. Educ..

[16]  Joel R. Evans,et al.  The value of online surveys , 2005, Internet Res..

[17]  Elin Wihlborg,et al.  Development of quality management in education : A comparative case study in the Swedish multi-level governance system , 2016 .

[18]  Clara Morgan,et al.  A review of the Organisation for Economic Cooperation and Development's international education surveys: Governance, human capital discourses, and policy debates , 2016 .

[19]  Katja Lozar Manfreda,et al.  The effect of email invitation elements on response rate in a web survey within an online community , 2016, Comput. Hum. Behav..

[20]  Juan Sánchez-Fernández,et al.  Improving the response rate and quality in Web-based surveys through the personalization and frequency of reminder mailings , 2010 .

[21]  Vidal Díaz de Rada,et al.  Internet, Phone, Mail and Mixed-Mode Surveys: The Tailored Design Method. Don A. Dillman, Jolene D. Smyth y Leah Melani Christian. (New Jersey, John Wiley and Sons, 2014) , 2016 .

[22]  Juan Sánchez-Fernández,et al.  Improving retention rate and response quality in Web-based surveys , 2012, Comput. Hum. Behav..

[23]  Zheng Yan,et al.  Factors affecting response rates of the web survey: A systematic review , 2010, Comput. Hum. Behav..

[24]  Karen Shakman,et al.  Principals' Time, Tasks, and Professional Development: An Analysis of Schools and Staffing Survey Data. REL 2017-201. , 2016 .

[25]  Agneta Hult,et al.  Balancing managerial and professional demands: school principals as evaluation brokers , 2016 .

[26]  M. Roach,et al.  Increasing Web Survey Response Rates in Innovation Research: An Experimental Study of Static and Dynamic Contact Design Features , 2012 .

[27]  Magdalena Stadin,et al.  Information and communication technology demands at work: the association with job strain, effort-reward imbalance and self-rated health in different socio-economic strata , 2016, International Archives of Occupational and Environmental Health.

[28]  Tse-Hua Shih,et al.  Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis , 2008 .

[29]  S. Baron,et al.  Online Surveys in Marketing Research , 2002 .

[30]  Laurie Thorp,et al.  The Effect of Invitation Design on Web Survey Response Rates , 2012 .

[31]  Ailsa C. M. Jerejian,et al.  The contribution of email volume, email management strategies and propensity to worry in predicting email stress among academics , 2013, Comput. Hum. Behav..

[32]  Andrew Gray,et al.  How responsive are government agencies when contacted by email? Findings from a longitudinal study in Australia and New Zealand , 2016, Gov. Inf. Q..

[33]  Hepu Deng,et al.  Critical factors for evaluating the public value of e-government in Sri Lanka , 2012, Gov. Inf. Q..

[34]  Benjamin V. Hanrahan,et al.  Lost in Email: Pulling Users Down a Path of Interaction , 2015, CHI.

[35]  S. Baron,et al.  ONLINE SURVEYS IN MARKETING RESEARCH: PROS AND CONS , 2002 .

[36]  Beverly Wright,et al.  Online Survey Research: Can Response Factors Be Improved? , 2008 .

[37]  Pamela Campanelli,et al.  Cognitive interviewing as tool for enhancing the accuracy of the interpretation of quantitative findings , 2016 .

[38]  Stephen R. Porter,et al.  E-mail Subject Lines and Their Effect on Web Survey Viewing and Response , 2005 .

[39]  Dorit Tubin,et al.  Leadership identity construction practices , 2017 .

[40]  Mutaz M. Al-Debei,et al.  The imperative of influencing citizen attitude toward e-government adoption and use , 2015, Comput. Hum. Behav..

[41]  Herbert Kubicek,et al.  Closing the Evaluation Gap in e-Participation Research and Practice , 2016 .

[42]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[43]  Guangwei Hu,et al.  A Management Approach of E-government Service Capability: An ITIL Perspective , 2016 .

[44]  Dara V. O'Neil.  Analysis of Internet Users’ Level of Online Privacy Concerns , 2001 .

[45]  Charles H Goldsmith,et al.  Population Survey Features and Response Rates: A Randomized Experiment. , 2016, American journal of public health.

[46]  Claudia Holland,et al.  Information Overload and Underload , 2016 .

[47]  Dana Huyser de Bernardo,et al.  Using Online and Paper Surveys , 2013 .

[48]  Rik Crutzen,et al.  Reminders in Web-Based Data Collection , 2012 .

[49]  Florian Keusch,et al.  Why do people participate in Web surveys? Applying survey participation theory to Internet survey data collection , 2015, Management Review Quarterly.

[50]  P. Hardigan,et al.  Response rate, response time, and economic costs of survey research: A randomized trial of practicing pharmacists. , 2016, Research in social & administrative pharmacy : RSAP.

[51]  Theresa Deussen,et al.  Recruiting Rural Schools for Education Research: Challenges and Strategies , 2017 .

[52]  Yung-Ting Lee,et al.  User Satisfaction of the Website for National Center for Health Communication and Education in Vietnam: An Application of IS Success Model , 2015, ICEC '15.

[53]  Kenneth W. Green,et al.  Doing Survey Research on the Internet: Yes, Timing Does Matter , 2004, J. Comput. Inf. Syst..