An empirical study of spreadsheet authors' mental models in explaining and debugging tasks

In this paper, we report on an empirical study exploring the nature of mental models of spreadsheet authors when they are explaining and debugging their own spreadsheets. Study participants were first asked to explain one of their own spreadsheets, and then to find and fix seeded errors in the same spreadsheets. Talk-aloud protocols were collected and analyzed to reveal the nature of participants' mental models in these activities. The findings indicate that the authors explain their spreadsheets mainly in terms of real-world and problem domain concepts; in debugging, they constantly switch between problem domain concepts and spreadsheet-specific concepts, although they mainly use spreadsheet-specific concepts to fix an identified error. These study findings provide insights on the need for developing spreadsheet authoring and debugging tools that correspond to spreadsheet authors' mental models of spreadsheets.

[1]  N. Pennington Stimulus structures and mental representations in expert comprehension of computer programs , 1987, Cognitive Psychology.

[2]  Robert B. Allen,et al.  Mental Models and User Models , 1997 .

[3]  David G. Hendry,et al.  Creating, comprehending and explaining spreadsheets: a cognitive interpretation of what discretionary users think of the spreadsheet model , 1994, Int. J. Hum. Comput. Stud..

[4]  Margaret-Anne D. Storey,et al.  Theories, Methods and Tools in Program Comprehension: Past, Present and Future , 2005, IWPC.

[5]  Stephen G. Powell,et al.  Impact of errors in operational spreadsheets , 2009, Decis. Support Syst..

[6]  Jorma Sajaniemi,et al.  An empirical analysis of spreadsheet calculation , 1988, Softw. Pract. Exp..

[7]  Anneliese Amschler Andrews,et al.  Program Comprehension During Software Maintenance and Evolution , 1995, Computer.

[8]  Bonnie A. Nardi,et al.  Beyond Models and Metaphors: Visual Formalisms in User Interface Design , 1993, J. Vis. Lang. Comput..

[9]  Stanley Letovsky,et al.  Cognitive processes in program comprehension , 1986, J. Syst. Softw..

[10]  Judith Good Programming paradigms, information types and graphical representations : empirical investigations of novice program comprehension , 1999 .

[11]  Raymond R. Panko,et al.  What we know about spreadsheet errors , 1998 .

[12]  David N. Ford,et al.  Mental models concepts for system dynamics research , 1998 .

[13]  Steven E. Stemler,et al.  An Overview of Content Analysis. , 2001 .