Cost evaluation of coverage directed test generation for the IBM mainframe

Test generation and simulation tools have input stimuli that can direct them to cover specific events. However, the cost of completely covering a verification plan is still very high. While coverage analysis tools can find events that have not been covered, they do not provide an automated covering method. This paper presents the first implementation of a generation framework that uses feedback from coverage analysis to direct microarchitecture simulation. This framework uses a coverage analysis tool to find events that have not been simulated and then utilizes information about the design to determine which directives should be given to the simulation environment. This paper describes, in detail, the system and its operation process, an experiment that uses the system, and the results of the experiment. This system was shown to reduce the machine time and person time required to cover the test plan. Implications of this work suggest the types of verification plans appropriate for the utilization of this system and the further experiments and developments required.

[1]  A. Ziv,et al.  Off-The-Shelf Vs . Custom Made Coverage Models , Which Is The One for You ? , 1998 .

[2]  Steven M. Licker,et al.  Functional verification of the CMOS S/390 Parallel Enterprise Server G4 system , 1997, IBM J. Res. Dev..

[3]  Dean H. Lorenz,et al.  A Methodology for Processor Implementation Verification , 1996, FMCAD.

[4]  Barry K. Rosen,et al.  Architectural verification of processors using symbolic instruction graphs , 1994, Proceedings 1994 IEEE International Conference on Computer Design: VLSI in Computers and Processors.

[5]  Avi Ziv,et al.  Design reliability-estimation through statistical analysis of bug discovery data , 1998, Proceedings 1998 Design and Automation Conference. 35th DAC. (Cat. No.98CH36175).

[6]  S. Ur,et al.  Micro architecture coverage directed generation of test programs , 1999, Proceedings 1999 Design Automation Conference (Cat. No. 99CH36361).

[7]  Trung A. Diep,et al.  Systematic validation of pipeline interlock for superscalar microarchitectures , 1995, Twenty-Fifth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[8]  Brian Marick Book Reviews: The Craft of Software Testing: Subsystem Testing Including Object-Based and Object-Oriented Testing, Brian Maxick , 1994, SOEN.

[9]  Avi Ziv,et al.  User defined coverage—a tool supported methodology for design verification , 1998, DAC.

[10]  Pak-kin Mak,et al.  The S/390 G5/G6 binodal cache , 1999, IBM J. Res. Dev..

[11]  Avner Landver,et al.  Coverage-Directed Test Generation Using Symbolic Techniques , 1996, FMCAD.