Testing Homogeneous Spreadsheet Grids with the "What You See Is What You Test" Methodology

Although there has been recent research into ways to design environments that enable end users to create their own programs, little attention has been given to helping these end users systematically test their programs. To help address this need in spreadsheet systems (the most widely used type of end-user programming language), we previously introduced a visual approach to systematically testing individual cells in spreadsheet systems. However, the previous approach did not scale well in the presence of largely homogeneous grids, which introduce problems somewhat analogous to the array-testing problems of imperative programs. We present two approaches to spreadsheet testing that explicitly support such grids. We present the algorithms, time complexities, and performance data comparing the two approaches. This is part of our continuing work to bring to end users at least some of the benefits of formalized notions of testing without requiring knowledge of testing beyond a naive level.

[1]  Gregg Rothermel,et al.  Scaling up a "What you see is what you test" methodology to spreadsheet grids , 1999, Proceedings 1999 IEEE Symposium on Visual Languages.

[2]  Gregg Rothermel,et al.  What you see is what you test: a methodology for testing form-based visual programs , 1998, Proceedings of the 20th International Conference on Software Engineering.

[3]  J William,et al.  IEEE Computer Graphics and Applications , 2019, Computer.

[4]  Joseph Robert Horgan,et al.  Data flow coverage and the C language , 1991, TAV4.

[5]  Jennifer L. Leopold,et al.  Keyboardless visual programming using voice, handwriting, and gesture , 1997, Proceedings. 1997 IEEE Symposium on Visual Languages (Cat. No.97TB100180).

[6]  Roger B. Dannenberg,et al.  Garnet: comprehensive support for graphical, highly interactive user interfaces , 1990, Computer.

[7]  Richard G. Hamlet,et al.  Exploring dataflow testing of arrays , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[8]  Guijun Wang,et al.  Solving display-based problems , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[9]  Margaret M. Burnett,et al.  Forms/3: A first-order visual language to explore the boundaries of the spreadsheet paradigm , 2001, Journal of Functional Programming.

[10]  Clayton Lewis,et al.  Spreadsheet-based interactive graphics: from prototype to tool , 1990, CHI '90.

[11]  E.H. Chi,et al.  Principles for Information Visualization Spreadsheets , 1998, IEEE Computer Graphics and Applications.

[12]  Janusz W. Laski,et al.  A Data Flow Oriented Program Testing Strategy , 1983, IEEE Transactions on Software Engineering.

[13]  Brad A. Myers Graphical techniques in a spreadsheet for specifying user interfaces , 1991, CHI '91.

[14]  Elaine J. Weyuker,et al.  An Applicable Family of Data Flow Testing Criteria , 1988, IEEE Trans. Software Eng..

[15]  Alfred V. Aho,et al.  Compilers: Principles, Techniques, and Tools , 1986, Addison-Wesley series in computer science / World student series edition.

[16]  Margaret M. Burnett,et al.  Exception Handling in the Spreadsheet Paradigm , 2000, IEEE Trans. Software Eng..

[17]  Margaret Tan,et al.  Quantitative and qualitative errors in spreadsheet development , 1997, Proceedings of the Thirtieth Hawaii International Conference on System Sciences.

[18]  Gregg Rothermel,et al.  WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[19]  Gregg Rothermel,et al.  A methodology for testing spreadsheets , 2001, TSEM.

[20]  Philip T. Cox,et al.  Expanding the utility of spreadsheets through the integration of visual programming and user interface objects , 1996, AVI '96.

[21]  John D. Gould,et al.  An experimental study of people creating spreadsheets , 1987, TOIS.

[22]  Gregg Rothermel,et al.  Testing strategies for form-based visual programs , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[23]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[24]  Margaret M. Burnett,et al.  Similarity inheritance: a new model of inheritance for spreadsheet VPLs , 1998, Proceedings. 1998 IEEE Symposium on Visual Languages (Cat. No.98TB100254).

[25]  Dennis F. Galletta,et al.  An empirical study of spreadsheet error-finding performance , 1993 .

[26]  Henry C. Lucas,et al.  Spreadsheet analysis and design , 1989, CACM.

[27]  Gregg Rothermel,et al.  Slicing spreadsheets: an integrated methodology for spreadsheet testing and debugging , 1999, DSL '99.

[28]  Raymond R. Panko,et al.  What we know about spreadsheet errors , 1998 .

[29]  Margaret M. Burnett,et al.  Graphical definitions: expanding spreadsheet languages through direct manipulation and gestures , 1998, TCHI.