Business and Impact Alignment of Questionnaire

Survey is a quick common instrument for information gathering. One of the most common forms of the survey is a questionnaire. Questionnaire is “a technique for gathering statistical information about the attributes, attitudes or actions of a population by administering standardized questions to some or all its members.” [5] In this thesis we are discussing business impact of questionnaire and problems related to questionnaire design. Aim of this project is universal solution for questionnaire design. In our opinion, questionnaire design has appeared as the weakest link in the survey. Moreover, not everyone realizes that it causes frequently confusing results. We decided to design our own solution for that. We propose a new methodology of questionnaire design. Our approach is based on start-point framework and testing/verification part of the questionnaire on its developing stage. Notion consists of possibility to test and verify questionnaire for design issues before carry it out to the target group. This option additionally helps to design question types, avoid different sources of bias, and sometimes correct and review the research questions. The proposed approach for testing and verification includes three closed loops of iterations, researcher needs to run to improve the questionnaire. One of the advantages of our approach, which we would like to highlight, is simplicity of iterations, which can be repeated constantly until the quality of the questionnaire will be satisfactory. Loops give researcher different options of how to improve the questionnaire. Loops can be used separately or all together. Then, depending on time resources, researcher can choose one or more options and, additionally, the number of the iterations. We believe that our methodology will enhance the questionnaire performance significantly, hence, the survey results quality in general. To test our own methodology, the conducted survey at Gjovik University College has been chosen. The survey was addressed to measure the effectiveness of information security awareness program [43]. The survey was held in 2011 within the employees of Gjovik University College. The survey is a part of another master thesis, which has been done in collaboration with Norsk Senter for Informasjonssikring (NorSIS). In this master thesis, NorSIS has requested to perform a new evaluation of this survey to assume better results. In terms of this project, we provide a full re-evaluation of the survey: starting from questionnaire design and ending with results interpretation. For the re-evaluation, we use our own methodology to present it in working conditions. Evaluation of questionnaire design has an impact on the statistical analysis and influences the results. The statistical analysis is performed using IBM SPSS Statistics software solutions and addressed to measure effectiveness of the training programs and their separate performances. The re-evaluation results are presented with counted in impact of questionnaire design analysis.

[1]  William G. Zikmund,et al.  Exploring Marketing Research , 1986 .

[2]  L Del Greco,et al.  Questionnaire development: 2. Validity and reliability. , 1987, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[3]  A. N. Oppenheim,et al.  Questionnaire Design, Interviewing and Attitude Measurement , 1992 .

[4]  Peter M. Chisnall,et al.  Questionnaire Design, Interviewing and Attitude Measurement , 1993 .

[5]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[6]  G H Guyatt,et al.  Development and validation of a questionnaire to measure asthma control. , 1999, The European respiratory journal.

[7]  Udo Lindemann,et al.  Effort-saving product representations in design—results of a questionnaire survey , 2001 .

[8]  James E. Bartlett,et al.  Organizational research: Determining appropriate sample size in survey research , 2001 .

[9]  Stephanie Teufel,et al.  Information Security Culture: The Socio-Cultural Dimension in Information Security Management , 2002, SEC.

[10]  Stephanie Teufel,et al.  Information security culture - from analysis to change , 2003, South Afr. Comput. J..

[11]  Abdulwahed Mohammed Khalfan,et al.  Information security considerations in IS/IT outsourcing projects: a descriptive case study of two sectors , 2004, Int. J. Inf. Manag..

[12]  Peter Saunders,et al.  The survey methods workbook : from design to analysis , 2004 .

[13]  Jan Guynes Clark,et al.  Why there aren't more information security research studies , 2004, Inf. Manag..

[14]  M. Whitman,et al.  Management Of Information Security , 2004 .

[15]  Stephanie Teufel,et al.  Tool Supported Management of Information Security Culture , 2005, SEC.

[16]  Hennie A. Kruger,et al.  A prototype for assessing information security awareness , 2006, Comput. Secur..

[17]  Günter Müller Budgeting process for information security expenditures , 2006, Wirtsch..

[18]  Michael D. Myers,et al.  The qualitative interview in IS research: Examining the craft , 2007, Inf. Organ..

[19]  J. Pallant SPSS survival manual : a step-by-step guide to data analysis using SPSS version 15 , 2007 .

[20]  H. Vorst,et al.  Reducing the Length of Questionnaires through Structurally Incomplete Designs: An Illustration. , 2007 .

[21]  P. Chisnall Mail and Internet Surveys: The Tailored Design Method , 2007, Journal of Advertising Research.

[22]  Vasja Vehovar,et al.  Measuring ego-centered social networks on the web: Questionnaire design issues , 2008, Soc. Networks.

[23]  Zheng Yan,et al.  Factors affecting response rates of the web survey: A systematic review , 2010, Comput. Hum. Behav..

[24]  W. R. Howard Managing the Human Factor in Information Security: How to Win Over Staff and Influence Business Managers , 2010 .

[25]  Jan H. P. Eloff,et al.  A framework and assessment instrument for information security culture , 2010, Comput. Secur..

[26]  Ilirjana Veseli,et al.  Measuring the Effectiveness of Information Security Awareness Program , 2011 .

[27]  Hsiao-Lien Chen,et al.  A Questionnaire Survey , 2011 .

[28]  James O. Chipperfield,et al.  Efficiency of split questionnaire surveys , 2011 .

[29]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[30]  Juan Sánchez-Fernández,et al.  Improving retention rate and response quality in Web-based surveys , 2012, Comput. Hum. Behav..

[31]  Gang Kou,et al.  Questionnaire design improvement and missing item scores estimation for rapid and efficient decision making , 2012, Ann. Oper. Res..

[32]  Rachad Antonius Interpreting Quantitative Data with IBM SPSS Statistics , 2012 .

[33]  William E. Wagner,et al.  Using IBM® SPSS® Statistics for Research Methods and Social Science Statistics , 2012 .

[34]  Igor Makienko,et al.  Teaching applied value of marketing research: A questionnaire design project , 2012 .

[35]  Bettina Grün,et al.  “Translating” between survey answer formats☆ , 2013, Journal of business research.