A formal approach to testing programs in practice

A program required to be tested in practice often has no available source code for some reason and how to adequately test such a program is still an open problem. In this paper, we describe a formal specification-based testing approach to tackle this challenge. The principal idea is first to formalize the informal requirements into formal operation specifications that take the interface scenarios of the program into account, and then utilize the specifications for test case generation and test result analysis. An example and case study of applying the approach to an IC card system is presented to illustrate its usage and analyze its performance.

[1]  Mark Blackburn,et al.  Interface-Driven, Model-Based Test Automation , 2003 .

[2]  Shaoying Liu,et al.  A Rigorous Method for Inspection of Model-Based Formal Specifications , 2010, IEEE Transactions on Reliability.

[3]  Dan Craigen,et al.  Industrial applications of formal methods to model, design and analyze computer systems: an international survey , 1995 .

[4]  Jeff Offutt,et al.  Generating Test Cases from UML Specifications , 1999 .

[5]  Alexander Pretschner,et al.  Model-Based Testing in Practice , 2005, FM.

[6]  Marie-Claude Gaudel,et al.  Software testing based on formal specifications: a theory and a tool , 1991, Softw. Eng. J..

[7]  David A. Carrington,et al.  A Framework for Specification-Based Testing , 1996, IEEE Trans. Software Eng..

[8]  Shaoying Liu,et al.  Automated Functional Scenarios-Based Formal Specification Animation , 2012, 2012 19th Asia-Pacific Software Engineering Conference.

[9]  Paola Inverardi,et al.  Towards Anti-Model-based Testing , 2004 .

[10]  Shaoying Liu,et al.  A Pattern-Based Approach to Formal Specification Construction , 2011, FGIT-ASEA/DRBC/EL.

[11]  Andreas Hoffmann,et al.  Model-Based Testing , 2012, IEEE Software.

[12]  Jean Hartmann,et al.  UML-Based integration testing , 2000, ISSTA '00.

[13]  Jeremy Dick,et al.  Automating the Generation and Sequencing of Test Cases from Model-Based Specifications , 1993, FME.

[14]  James A. Whittaker,et al.  Model‐Based Software Testing , 2002 .

[15]  Erich Novak,et al.  Special issue , 2006, J. Complex..

[16]  Shaoying Liu.  Formal Engineering for Industrial Software Development: Using the SOFL Method , 2004 .

[17]  Shaoying Liu,et al.  An Automated Approach to Specification-Based Program Inspection , 2005, ICFEM.