An Empirical Study of End-User Behaviour in Spreadsheet Error Detection & Correction

Very little is known about the process by which end-user developers detect and correct spreadsheet errors. Any research pertaining to the development of spreadsheet testing methodologies or auditing tools would benefit from information on how end-users perform the debugging process in practice. Thirteen industry-based professionals and thirty-four accounting & finance students took part in a current ongoing experiment designed to record and analyse end-user behaviour in spreadsheet error detection and correction. Professionals significantly outperformed students in correcting certain error types. Time-based cell activity analysis showed that a strong correlation exists between the percentage of cells inspected and the number of errors corrected. The cell activity data was gathered through a purpose written VBA Excel plug-in that records the time and detail of all cell selection and cell change actions of individuals.

[1]  Dennis F. Galletta,et al.  An empirical study of spreadsheet error-finding performance , 1993 .

[2]  Gregg Rothermel,et al.  Integrating automated test generation into the WYSIWYT spreadsheet testing methodology , 2006, TSEM.

[3]  Ying Chen,et al.  An Exploratory Study of Spreadsheet Debugging Processes , 2000, PACIS.

[4]  Raymond R. Panko,et al.  What we know about spreadsheet errors , 1998 .

[5]  Dennis F. Galletta,et al.  An experimental study of spreadsheet presentation and error detection , 1996, Proceedings of HICSS-29: 29th Hawaii International Conference on System Sciences.

[6]  Yogesh Deshpande,et al.  Verification and validation and complex environments: a study in service sector , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[7]  Mark G. Simkin,et al.  Factors Affecting the Ability to Detect Spreadsheet Errors , 2006 .

[8]  Margaret M. Burnett,et al.  End-user software visualizations for fault localization , 2003, SoftVis '03.

[9]  Brian Knight,et al.  Quality control in spreadsheets: a software engineering-based approach to spreadsheet development , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[10]  Raymond R. Panko,et al.  Applying Code Inspection to Spreadsheet Testing , 1999, J. Manag. Inf. Syst..

[11]  Gregg Rothermel,et al.  A methodology for testing spreadsheets , 2001, TSEM.

[12]  Margaret Tan,et al.  Quantitative and qualitative errors in spreadsheet development , 1997, Proceedings of the Thirtieth Hawaii International Conference on System Sciences.

[13]  David Chadwick.  Stop that Subversive Spreadsheet! , 2002, IICIS.

[14]  Grenville J. Croll.  The Importance and Criticality of Spreadsheets in the City of London , 2007, ArXiv.

[15]  Kevin McDaid,et al.  Test-Driven Development: Can It Work for Spreadsheet Engineering? , 2006, XP.