On the validation of embedded systems through functional ATPG

Increasing size and complexity of digital designs has made essential to address critical verification issues at the early stages of design cycle. Therefore, automated verification tools are necessary at higher levels of abstraction, but they are still in a prototyping phase. In this context, a valuable solution for the functional validation is represented by dynamic verification which exploits simulation-based techniques to stimulate the whole design under verification (DUV). To perform dynamic verification it is necessary to generate test sequences to be simulated on the DUV. This paper describes a functional test pattern generator which exploits two different paradigms: high-level decision diagrams (HLDDs) and extended finite state machines (EFSMs). HLDDs and EFSMs are deterministically explored by using propagation, justification, learning and backjumping. The integration of such strategies allows the ATPG to more efficiently analyze the state space of the design under verification and to generate very effective test sequences.

[1]  Vladimir N. Fleyshgakker,et al.  Efficient mutation analysis: a new approach , 1994, ISSTA '94.

[2]  Cristina Marconcini A functional ATPG as a bridge between functional verification and testing , 2008 .

[3]  Shmuel Katz,et al.  Partially Interpreted Schemas for CSP Programming , 1988, Sci. Comput. Program..

[4]  Massimo Poncino,et al.  SystemC co-simulation for core-based embedded systems , 2007, Des. Autom. Embed. Syst..

[5]  Michael S. Hsiao,et al.  Efficient sequential atpg for functional rtl circuits , 2003, International Test Conference, 2003. Proceedings. ITC 2003..

[6]  David G. Chinnery,et al.  A functional validation technique: biased-random simulation guided by observability-based coverage , 2001, Proceedings 2001 IEEE International Conference on Computer Design: VLSI in Computers and Processors. ICCD 2001.

[7]  Ahmad A. Al-Yamani,et al.  Built-in reseeding for serial BIST , 2003, Proceedings. 21st VLSI Test Symposium, 2003..

[8]  Jehoshua Bruck,et al.  The synthesis of cyclic combinational circuits , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).

[9]  Jacob A. Abraham,et al.  A METHODOLOGY FOR FUNCTIONAL LEVEL TESTING OF MICROPROCESSORS , 1995, Twenty-Fifth International Symposium on Fault-Tolerant Computing, 1995, ' Highlights from Twenty-Five Years'..

[10]  A. Jefferson Offutt,et al.  Experimental results from an automatic test case generator , 1993, TSEM.

[11]  João Paulo Teixeira,et al.  Implicit functionality and multiple branch coverage (IFMB): a testability metric for RT-level , 2001, Proceedings International Test Conference 2001 (Cat. No.01CH37260).

[12]  J.R. Armstrong Chip-level modeling with HDLs , 1988, IEEE Design & Test of Computers.

[13]  Wolfgang Roesner,et al.  Comprehensive Functional Verification: The Complete Industry Cycle , 2005 .

[14]  Roy P. Pargas,et al.  Mutation Testing of Software Using MIMD Computer , 1992, ICPP.

[15]  Raimund Ubar,et al.  Back-tracing and event-driven techniques in high-level simulation with decision diagrams , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[16]  Wu-Tung Cheng,et al.  Differential Fault Simulation - A Fast Method Using Minimal Memory , 1989, 26th ACM/IEEE Design Automation Conference.

[17]  Franco Fummi,et al.  Genetic algorithms: the philosopher's stone or an effective solution for high-level TPG? , 2003, Eighth IEEE International High-Level Design Validation and Test Workshop.

[18]  Sumit Ghosh,et al.  On behavior fault modeling for combinational digital designs , 1988, International Test Conference 1988 Proceeding@m_New Frontiers in Testing.

[19]  William E. Howden,et al.  Weak Mutation Testing and Completeness of Test Sets , 1982, IEEE Transactions on Software Engineering.

[20]  Brian Marick,et al.  The weak mutation hypothesis , 1991, TAV4.

[21]  A. Jefferson Offutt,et al.  Mutation 2000: uniting the orthogonal , 2001 .

[22]  Luca Benini,et al.  SystemC Cosimulation and Emulation of Multiprocessor SoC Designs , 2003, Computer.

[23]  Richard J. Lipton,et al.  The design of a prototype mutation system for program testing , 1899, AFIPS National Computer Conference.

[24]  Prithviraj Banerjee A Model for Simulating Physical Failures in MOS VLSI Circuits , 1982 .

[25]  John P. Hayes Fault Modeling for Digital MOS Integrated Circuits , 1984, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[26]  J. Uceda,et al.  A method to perform error simulation in VHDL ∗ , 1998 .

[27]  Ahmed Amine Jerraya,et al.  Automatic VHDL-C Interface Generation for Distributed Cosimulation: Application to Large Design Examples , 1998, Des. Autom. Embed. Syst..

[28]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[29]  Weichen Eric Wong On mutation and data flow , 1993 .

[30]  Srinivas Devadas,et al.  Simulation vector generation from HDL descriptions for observability-enhanced statement coverage , 1999, DAC '99.

[31]  Edmund M. Clarke,et al.  Design and Synthesis of Synchronization Skeletons Using Branching Time Temporal Logic , 2008, 25 Years of Model Checking.

[32]  Janak H. Patel,et al.  Proofs: a fast, memory efficient sequential circuit fault simulator , 1991, DAC '90.

[33]  Elizabeth M. Rudnick,et al.  Combining Deterministic and Genetic Approaches for Sequential Circuit Test Generation , 1995, 32nd Design Automation Conference.

[34]  Massimo Bombana,et al.  SystemC-VHDL co-simulation and synthesis in the HW domain , 2003, 2003 Design, Automation and Test in Europe Conference and Exhibition.

[35]  Elizabeth M. Rudnick,et al.  A genetic algorithm framework for test generation , 1997, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[36]  Ahmed Amine Jerraya,et al.  Fast timed cosimulation of HW/SW implementation of embedded multiprocessor SoC communication , 2001, Sixth IEEE International High-Level Design Validation and Test Workshop.

[37]  Kurt Keutzer,et al.  Functional vector generation for HDL models using linear programming and 3-satisfiability , 1998, Proceedings 1998 Design and Automation Conference. 35th DAC. (Cat. No.98CH36175).

[38]  Fabrizio Ferrandi,et al.  Functional verification for SystemC descriptions using constraint solving , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[39]  M. R. Woodward,et al.  From weak to strong, dead or alive? an analysis of some mutation testing issues , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[40]  Amir Pnueli,et al.  Checking that finite state concurrent programs satisfy their linear specification , 1985, POPL.

[41]  R. D. Blanton,et al.  Using regression analysis for GA-based ATPG parameter optimization , 1998, Proceedings International Conference on Computer Design. VLSI in Computers and Processors (Cat. No.98CB36273).

[42]  F. Gail Gray,et al.  Micro-operation perturbations in chip level fault modeling , 1988, 25th ACM/IEEE, Design Automation Conference.Proceedings 1988..

[43]  Gregg Rothermel,et al.  An experimental evaluation of selective mutation , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[44]  Shi-Yu Huang,et al.  AQUILA: An Equivalence Checking System for Large Sequential Designs , 2000, IEEE Trans. Computers.

[45]  Fabrizio Ferrandi,et al.  Behavioral test generation for the selection of BIST logic , 2002, J. Syst. Archit..

[46]  Richard G. Hamlet,et al.  Testing Programs with the Aid of a Compiler , 1977, IEEE Transactions on Software Engineering.

[47]  Paolo Prinetto,et al.  Testability analysis and ATPG on behavioral RT-level VHDL , 1997, Proceedings International Test Conference 1997.

[48]  L. J. Morell Theoretical insights into fault-based testing , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[49]  Armin Biere,et al.  Symbolic Model Checking without BDDs , 1999, TACAS.

[50]  Davide Bresolin,et al.  The impact of EFSM composition on functional ATPG , 2009, 2009 12th International Symposium on Design and Diagnostics of Electronic Circuits & Systems.

[51]  Soonhoi Ha,et al.  Virtual synchronization technique with OS modeling for fast and time-accurate cosimulation , 2003, First IEEE/ACM/IFIP International Conference on Hardware/ Software Codesign and Systems Synthesis (IEEE Cat. No.03TH8721).

[52]  T. Bengtsson,et al.  Functional Test Generation for Finite State Machines , 2006, 2006 International Biennial Baltic Electronics Conference.

[53]  Ali Y. Duale,et al.  Resolving inconsistencies in EFSM-modeled specifications , 1999, MILCOM 1999. IEEE Military Communications. Conference Proceedings (Cat. No.99CH36341).

[54]  Fabrizio Ferrandi,et al.  Test Generation and Testability Alternatives Exploration of Critical Algorithms for Embedded Applications , 2002, IEEE Trans. Computers.

[55]  Fausto Giunchiglia,et al.  NUSMV: a new symbolic model checker , 2000, International Journal on Software Tools for Technology Transfer.

[56]  Elizabeth M. Rudnick,et al.  Efficient Techniques for Dynamic Test Sequence Compaction , 1999, IEEE Trans. Computers.

[57]  John D. Backes,et al.  The analysis of cyclic circuits with Boolean satisfiability , 2008, 2008 IEEE/ACM International Conference on Computer-Aided Design.

[58]  Raimund Ubar,et al.  Fast Test Pattern Generation for Sequential Circuits Using Decision Diagram Representations , 2000, J. Electron. Test..

[59]  James R. Armstrong Chip Level Modeling of LSI Devices , 1984, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[60]  John P. Hayes,et al.  A Functional Approach to Testing Bit-Sliced Microprocessors , 1981, IEEE Transactions on Computers.

[61]  F. Fummi,et al.  Improving High-Level and Gate-Level Testing with FATE: a Functional ATPG Traversing Unstabilized EFSMs , 2007 .

[62]  Sundaram Seshu,et al.  On an Improved Diagnosis Program , 1965, IEEE Trans. Electron. Comput..

[63]  Irith Pomeranz,et al.  Techniques for improving the efficiency of sequential circuit test generation , 1999, 1999 IEEE/ACM International Conference on Computer-Aided Design. Digest of Technical Papers (Cat. No.99CH37051).

[64]  Franco Fummi,et al.  A 1000X speed up for properties completeness evaluation , 2002, Seventh IEEE International High-Level Design Validation and Test Workshop, 2002..

[65]  James R. Armstrong,et al.  Functional Fault Modeling and Simulation for VLSI Devices , 1985, 22nd ACM/IEEE Design Automation Conference.

[66]  Armando Tacchella,et al.  Benefits of Bounded Model Checking at an Industrial Setting , 2001, CAV.

[67]  Douglas B. Armstrong,et al.  A Deductive Method for Simulating Faults in Logic Circuits , 1972, IEEE Transactions on Computers.

[68]  David L. Landis,et al.  Partitioning sequential circuits for pseudoexhaustive testing , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[69]  Fabrizio Ferrandi,et al.  An application of genetic algorithms and BDDs to functional testing , 2000, Proceedings 2000 International Conference on Computer Design.

[70]  Elizabeth M. Rudnick,et al.  Sequential Circuit Test Generation Using a Symbolic/Genetic Hybrid Approach , 2001, J. Electron. Test..

[71]  Martin R. Woodward,et al.  An integrated system for program testing using weak mutation and data flow analysis , 1985, ICSE '85.

[72]  Armando Tacchella,et al.  Evaluating Search Heuristics and Optimization Techniques in Propositional Satisfiability , 2001, IJCAR.

[73]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[74]  Sumit Ghosh,et al.  On behavior fault modeling for digital designs , 1991, J. Electron. Test..

[75]  Bogdan Korel,et al.  Automated Software Test Data Generation , 1990, IEEE Trans. Software Eng..

[76]  Bin Li,et al.  A novel SAT all-solutions solver for efficient preimage computation , 2004, Proceedings Design, Automation and Test in Europe Conference and Exhibition.

[77]  Franco Fummi,et al.  A VHDL error simulator for functional test generation , 2000, DATE '00.

[78]  Alberto L. Sangiovanni-Vincentelli,et al.  Software timing analysis using HW/SW cosimulation and instruction set simulator , 1998, Proceedings of the Sixth International Workshop on Hardware/Software Codesign. (CODES/CASHE'98).

[79]  Sérgio Vale Aguiar Campos,et al.  Symbolic Model Checking , 1993, CAV.

[80]  R.A. DeMillo,et al.  An extended overview of the Mothra software testing environment , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[81]  Pedro J. Gil,et al.  Comparison and application of different VHDL-based fault injection techniques , 2001, Proceedings 2001 IEEE International Symposium on Defect and Fault Tolerance in VLSI Systems.

[82]  Franco Fummi,et al.  On the use of a high-level fault model to check properties incompleteness , 2003, First ACM and IEEE International Conference on Formal Methods and Models for Co-Design, 2003. MEMOCODE '03. Proceedings..

[83]  Zebo Peng,et al.  High-level and hierarchical test sequence generation , 2002, Seventh IEEE International High-Level Design Validation and Test Workshop, 2002..

[84]  A. Prasad Sistla,et al.  The complexity of propositional linear temporal logics , 1982, STOC '82.

[85]  Vi Andrew Jefferson Offutt,et al.  Automatic test data generation , 1988 .

[86]  C. Cote,et al.  Automated SystemC to VHDL translation in hardware/software codesign , 2002, 9th International Conference on Electronics, Circuits and Systems.

[87]  Kwang-Ting Cheng,et al.  Automatic generation of functional vectors using the extended finite state machine model , 1996, TODE.

[88]  Timothy Alan Budd,et al.  Mutation analysis of program test data , 1980 .

[89]  Fabrizio Ferrandi,et al.  Symbolic functional vector generation for VHDL specifications , 1999, Design, Automation and Test in Europe Conference and Exhibition, 1999. Proceedings (Cat. No. PR00078).

[90]  Stephen A. Szygenda,et al.  Digital Logic Simulation in a Time-Based, Table-Driven Environment , 1975, Computer.

[91]  Nacer-Eddine Zergainoh,et al.  Multilanguage design of heterogeneous systems , 1999, Proceedings of the Seventh International Workshop on Hardware/Software Codesign (CODES'99) (IEEE Cat. No.99TH8450).

[92]  Daniel D. Gajski,et al.  Essential Issues in Codesign , 1997 .

[93]  Giovanni Squillero,et al.  Effective techniques for high-level ATPG , 2001, Proceedings 10th Asian Test Symposium.

[94]  Luciano Lavagno,et al.  Hardware-software co-design of embedded systems: the POLIS approach , 1997 .

[95]  Pedro J. Gil,et al.  A prototype of a VHDL-based fault injection tool: description and application , 2002, J. Syst. Archit..

[96]  J. Hooker Constraint programming , 2003 .

[97]  Daniel Brand Verification of large synthesized designs , 1993, ICCAD.

[98]  Ahmed Amine Jerraya,et al.  Timed HW-SW cosimulation using native execution of OS and application SW , 2002, Seventh IEEE International High-Level Design Validation and Test Workshop, 2002..

[99]  Massimo Poncino,et al.  ISS-centric modular HW/SW co-simulation , 2006, GLSVLSI '06.

[100]  K. N. King,et al.  A Fortran 77 interpreter for mutation analysis , 1987, PLDI.

[101]  Yvon Savaria,et al.  The role of model-level transactors and UML in functional prototyping of systems-on-chip: a software-radio application , 2005, Design, Automation and Test in Europe.

[102]  Krzysztof R. Apt,et al.  Constraint logic programming using Eclipse , 2007 .

[103]  Jacob A. Abraham,et al.  Test Generation for Microprocessors , 1980, IEEE Transactions on Computers.

[104]  F. Fummi,et al.  Automatic generation of EFSMs and HLDDs for functional ATPG , 2008, 2008 11th International Biennial Baltic Electronics Conference.

[105]  G. Harik Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[106]  Sujit Dey,et al.  Communication architecture tuners: a methodology for the design of high-performance communication architectures for system-on-chips , 2000, Proceedings 37th Design Automation Conference.

[107]  Ofer Strichman,et al.  Tuning SAT Checkers for Bounded Model Checking , 2000, CAV.

[108]  Barry W. Johnson,et al.  A Fault Injection Technique for VHDL Behavioral-Level Models , 1996, IEEE Des. Test Comput..

[109]  Andreas Kuehlmann,et al.  Equivalence checking using cuts and heaps , 1997, DAC.

[110]  Joseph Sifakis,et al.  Specification and verification of concurrent systems in CESAR , 1982, Symposium on Programming.

[111]  Bogdan Korel,et al.  Dynamic method for software test data generation , 1992, Softw. Test. Verification Reliab..

[112]  Douglas Baldwin,et al.  Heuristics for Determining Equivalence of Program Mutations. , 1979 .

[113]  Edward A. Lee,et al.  Ptolemy: A Framework for Simulating and Prototyping Heterogenous Systems , 2001, Int. J. Comput. Simul..

[114]  M. Umit Uyar,et al.  Modeling VHDL specifications as consistent EFSMs , 1997, MILCOM 97 MILCOM 97 Proceedings.

[115]  Michael S. Hsiao,et al.  Fast Static Compaction Algorithms for Sequential Circuit Test Vectors , 1999, IEEE Trans. Computers.

[116]  Kwang-Ting Cheng,et al.  Efficient conflict-based learning in an RTL circuit constraint solver , 2005, Design, Automation and Test in Europe.

[117]  Irith Pomeranz,et al.  Theorems for efficient identification of indistinguishable fault pairs in synchronous sequential circuits , 2002, Proceedings 20th IEEE VLSI Test Symposium (VTS 2002).

[118]  Chien-In Henry Chen,et al.  VHDL behavioral ATPG and fault simulation of digital systems , 1998 .

[119]  Fabrizio Ferrandi,et al.  How an "evolving" fault model improves the behavioral test generation , 1997, Proceedings Great Lakes Symposium on VLSI.

[120]  Michael S. Hsiao,et al.  Efficient ATPG for design validation based on partitioned state exploration histories , 2004, 22nd IEEE VLSI Test Symposium, 2004. Proceedings..

[121]  K. S. How Tai Wah,et al.  Fault coupling in finite bijective functions , 1995, Softw. Test. Verification Reliab..

[122]  Michael S. Hsiao,et al.  Efficient sequential atpg based on partitioned finite-state-machine traversal , 2003, International Test Conference, 2003. Proceedings. ITC 2003..

[123]  Hilary Putnam,et al.  A Computing Procedure for Quantification Theory , 1960, JACM.

[124]  M. Ümit Uyar,et al.  A method enabling feasible conformance test sequence generation for EFSM models , 2004, IEEE Transactions on Computers.

[125]  Giovanni Squillero,et al.  An RT-level fault model with high gate level correlation , 2000, Proceedings IEEE International High-Level Design Validation and Test Workshop (Cat. No.PR00786).

[126]  Joao Marques-Silva,et al.  Towards Equivalence Checking Between TLM and RTL Models , 2007, 2007 5th IEEE/ACM International Conference on Formal Methods and Models for Codesign (MEMOCODE 2007).

[127]  Masahiro Fujita,et al.  Automatic test pattern generation for functional register-transferlevel circuits using assignment decision diagrams , 2001, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[128]  I.C. Teixeira,et al.  RTL-based functional test generation for high defects coverage in digital SOCs , 2000, Proceedings IEEE European Test Workshop.

[129]  Volkmar Sieh,et al.  VERIFY: evaluation of reliability using VHDL-models with embedded fault descriptions , 1997, Proceedings of IEEE 27th International Symposium on Fault Tolerant Computing.

[130]  Gregg Rothermel,et al.  An experimental determination of sufficient mutant operators , 1996, TSEM.

[131]  P. Eles,et al.  Verification of embedded systems using a Petri net based representation , 2000, Proceedings 13th International Symposium on System Synthesis.

[132]  F. Fummi,et al.  EFSM Manipulation to Increase High-Level ATPG , 2006 .

[133]  Alfredo Benso,et al.  Fault behavior observation of a microprocessor system through a VHDL simulation-based fault injection experiment , 1996, Proceedings EURO-DAC '96. European Design Automation Conference with EURO-VHDL '96 and Exhibition.

[134]  Franco Fummi,et al.  Functional verification based on the EFSM model , 2004, Proceedings. Ninth IEEE International High-Level Design Validation and Test Workshop (IEEE Cat. No.04EX940).

[135]  M. Wallace,et al.  Two problems-two solutions: one system-ECLIPSE , 1993 .

[136]  A. Jefferson Offutt,et al.  Detecting equivalent mutants and the feasible path problem , 1996, Proceedings of 11th Annual Conference on Computer Assurance. COMPASS '96.

[137]  A. Jefferson Offutt,et al.  Investigations of the software testing coupling effect , 1992, TSEM.

[138]  Randal E. Bryant,et al.  Graph-Based Algorithms for Boolean Function Manipulation , 1986, IEEE Transactions on Computers.

[139]  Elizabeth M. Rudnick,et al.  Diagnostic test generation for sequential circuits , 2000, Proceedings International Test Conference 2000 (IEEE Cat. No.00CH37159).

[140]  A. Jefferson Offutt,et al.  An Empirical Evaluation of Weak Mutation , 1994, IEEE Trans. Software Eng..

[141]  R. Lipton,et al.  Mutation analysis , 1998 .

[142]  Frederick C. Harris,et al.  Estimation and Enhancement of Real-Time Software Reliability Through Mutation Analysis , 1992, IEEE Trans. Computers.

[143]  Elizabeth M. Rudnick,et al.  Combining symbolic and genetic techniques for efficient sequential circuit test generation , 2000, Proceedings IEEE European Test Workshop.

[144]  Tom Blank,et al.  A Survey of Hardware Accelerators Used in Computer-Aided Design , 1984, IEEE Design & Test of Computers.

[145]  James R. Armstrong,et al.  B-algorithm: a behavioral test generation algorithm , 1994, Proceedings., International Test Conference.

[146]  Srivaths Ravi,et al.  Test generation for non-separable RTL controller-datapath circuits using a satisfiability based approach , 2003, Proceedings 21st International Conference on Computer Design.

[147]  Franco Fummi,et al.  Properties Incompleteness Evaluation by Functional Verification , 2007, IEEE Transactions on Computers.

[148]  S. Padmanabhuni Extended analysis of intelligent backtracking algorithms for the maximal constraint satisfaction problem , 1999, Engineering Solutions for the Next Millennium. 1999 IEEE Canadian Conference on Electrical and Computer Engineering (Cat. No.99TH8411).

[149]  Lori A. Clarke,et al.  Applications of symbolic evaluation , 1985, J. Syst. Softw..

[150]  Massimo Poncino,et al.  Native ISS-SystemC integration for the co-simulation of multi-processor SoC , 2004, Proceedings Design, Automation and Test in Europe Conference and Exhibition.

[151]  D. Hedley,et al.  A practical method for software quality control via program mutation , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[152]  Sérgio Vale Aguiar Campos,et al.  Compositional Reasoning in Model Checking , 1997, COMPOS.

[153]  James R. Armstrong,et al.  Behavioral fault simulation in VHDL , 1991, DAC '90.

[154]  Soonhoi Ha,et al.  Optimized timed hardware software cosimulation without roll-back , 1998, Proceedings Design, Automation and Test in Europe.

[155]  R. Holler,et al.  A Heterogeneous Hardware-Software Co-Simulation Environment Using User Mode Linux and Clock Suppression , 2006, 2006 2nd IEEE/ASME International Conference on Mechatronics and Embedded Systems and Applications.

[156]  A. J. Offutt A practical system for mutation testing: help for the common programmer , 1994, Proceedings., International Test Conference.

[157]  Richard E. Fairley An experimental program-testing facility , 1975, IEEE Transactions on Software Engineering.

[158]  K. S. How Tai Wah A Theoretical Study of Fault Coupling , 2000, Softw. Test. Verification Reliab..

[159]  Greg Kroah-Hartman,et al.  Linux Device Drivers, 3rd Edition , 2005 .

[160]  Fabrizio Ferrandi,et al.  Functional test generation for behaviorally sequential models , 2001, Proceedings Design, Automation and Test in Europe. Conference and Exhibition 2001.

[161]  Dynamic state traversal for sequential circuit test generation , 2000, TODE.

[162]  M. K. Iyer,et al.  SATORI - A Fast Sequential SAT Engine for Circuits , 2003, ICCAD 2003.

[163]  Aditya P. Mathur,et al.  High performance testing on SIMD machines , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[164]  J.A. Abraham,et al.  Fault and error models for VLSI , 1986, Proceedings of the IEEE.

[165]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[166]  Ian G. Harris,et al.  Design validation of behavioral VHDL descriptions for arbitrary fault models , 2005, European Test Symposium (ETS'05).

[167]  Luciano Lavagno,et al.  Behavioral-level test vector generation for system-on-chip designs , 2000, Proceedings IEEE International High-Level Design Validation and Test Workshop (Cat. No.PR00786).

[168]  Christian Norbert Zapf,et al.  MedusaMothra { A Distributed Interpreter for the Mothra Mutation Testing System , 1993 .

[169]  Giovanni De Micheli,et al.  Readings in hardware / software co-design , 2001 .

[170]  Robert M. Hierons,et al.  Expanding an extended finite state machine to aid testability , 2002, Proceedings 26th Annual International Computer Software and Applications.

[171]  Joel M. Schoen Performance and fault modeling with VHDL , 1992 .

[172]  Byoungju Choi,et al.  High-performance mutation testing , 1993, J. Syst. Softw..

[173]  J. A. Acree On mutation , 1980 .

[174]  A. Jefferson Offutt,et al.  Using compiler optimization techniques to detect equivalent mutants , 1994, Softw. Test. Verification Reliab..

[175]  Franco Fummi,et al.  AMLETO: a multi-language environment for functional test generation , 2001, Proceedings International Test Conference 2001 (Cat. No.01CH37260).

[176]  Franco Fummi,et al.  A methodology for abstracting RTL designs into TL descriptions , 2006, Fourth ACM and IEEE International Conference on Formal Methods and Models for Co-Design, 2006. MEMOCODE '06. Proceedings..

[177]  Franco Fummi,et al.  Vacuity Analysis by Fault Simulation , 2008, 2008 6th ACM/IEEE International Conference on Formal Methods and Models for Co-Design.

[178]  M.M. Denneau The Yorktown Simulation Engine , 1982, 19th Design Automation Conference.

[179]  Akihiko Tanaka Equivalence Testing for FORTRAN Mutation System Using Data Flow Analysis. , 1981 .

[180]  Franco Fummi,et al.  Logic-level mapping of high-level faults , 2005, Integr..

[181]  Paolo Prinetto,et al.  Initializability analysis of synchronous sequential circuits , 2002, TODE.

[182]  Fabrizio Ferrandi,et al.  Implicit test generation for behavioral VHDL models , 1998, Proceedings International Test Conference 1998 (IEEE Cat. No.98CH36270).

[183]  S. Ghosh Behavioral-level fault simulation , 1988, IEEE Design & Test of Computers.

[184]  A. Jefferson Offutt,et al.  How strong is weak mutation? , 1991, TAV4.

[185]  Gianpiero Cabodi,et al.  Improved reachability analysis of large finite state machines , 1996, Proceedings of International Conference on Computer Aided Design.

[186]  Roger Pressman,et al.  Software Engineering: A Practitioner's Approach, 7Th Edition , 2009 .

[187]  Robert A. Kowalski,et al.  Algorithm = logic + control , 1979, CACM.

[188]  Irith Pomeranz,et al.  Conflict driven techniques for improving deterministic test pattern generation , 2002, ICCAD 2002.

[189]  John P. Hayes A Fault Simulation Methodology for VLSI , 1982, 19th Design Automation Conference.

[190]  Marco Pistore,et al.  Improving the Encoding of LTL Model Checking into SAT , 2002, VMCAI.

[191]  Giovanni Squillero,et al.  A genetic algorithm-based system for generating test programs for microprocessor IP cores , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[192]  William H. Kautz,et al.  The Necessity of Closed Circuit Loops in Minimal Combinational Circuits , 1970, IEEE Transactions on Computers.

[193]  Lori A. Clarke,et al.  A System to Generate Test Data and Symbolically Execute Programs , 1976, IEEE Transactions on Software Engineering.

[194]  Sung-Joo Choi,et al.  Optimistic Timed HW-SW Cosimulation , 1997 .

[195]  Dhiraj K. Pradhan,et al.  Recursive learning: a new implication technique for efficient solutions to CAD problems-test, verification, and optimization , 1994, The IEEE International Symposium on Circuits and Systems, 2003. Tutorial Guide: ISCAS 2003..

[196]  Márcio Eduardo Delamaro,et al.  Proteum - A Tool for the Assessment of Test Adequacy for C Programs User's guide , 1996 .

[197]  Jean François Santucci,et al.  Pseudo-random behavioral ATPG , 1995, Proceedings. Fifth Great Lakes Symposium on VLSI.

[198]  Monika Müllerburg,et al.  Test data selection criteria for (software) integration testing , 1990, Systems Integration '90. Proceedings of the First International Conference on Systems Integration.

[199]  Rohit Kapur High level ATPG is important and is on its way! , 1999, International Test Conference 1999. Proceedings (IEEE Cat. No.99CH37034).

[200]  Robert K. Brayton,et al.  Implicit state enumeration of finite state machines using BDD's , 1990, 1990 IEEE International Conference on Computer-Aided Design. Digest of Technical Papers.

[201]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[202]  John P. Hayes,et al.  High-level test generation using physically-induced faults , 1995, Proceedings 13th IEEE VLSI Test Symposium.

[203]  Mark Harman,et al.  Using program slicing to assist in the detection of equivalent mutants , 1999, Softw. Test. Verification Reliab..

[204]  Daniel D. Gajski,et al.  High ― Level Synthesis: Introduction to Chip and System Design , 1992 .

[205]  Enrico Macii,et al.  Algorithms for approximate FSM traversal based on state space decomposition , 1996, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[206]  Rainer Leupers,et al.  A universal technique for fast and flexible instruction-set architecture simulation , 2002, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[207]  G. Cabodi,et al.  Implicit manipulation of equivalence classes for large finite state machines , 1998 .

[208]  Tughrul Arslan,et al.  Generating test patterns for VLSI circuits using a genetic algorithm , 1994 .

[209]  Kurt Keutzer,et al.  OCCOM: efficient computation of observability-based code coverage metrics for functional verification , 1998, Proceedings 1998 Design and Automation Conference. 35th DAC. (Cat. No.98CH36175).

[210]  Kurt Keutzer,et al.  An observability-based code coverage metric for functional simulation , 1996, Proceedings of International Conference on Computer Aided Design.

[211]  Dana Angluin,et al.  Two notions of correctness and their relation to testing , 1982, Acta Informatica.

[212]  Jacob A. Abraham,et al.  Functional Testing of Microprocessors , 1984, IEEE Transactions on Computers.

[213]  Sharad Malik,et al.  Chaff: engineering an efficient SAT solver , 2001, Proceedings of the 38th Design Automation Conference (IEEE Cat. No.01CH37232).

[214]  Johan Karlsson,et al.  Fault injection into VHDL models: the MEFISTO tool , 1994 .

[215]  Franco Fummi,et al.  A Pseudo-Deterministic Functional ATPG based on EFSM Traversing , 2005, 2005 Sixth International Workshop on Microprocessor Test and Verification.

[216]  Yutaka Hata,et al.  Controllability/observability measures for multiple-valued test generation based on D-algorithm , 2000, Proceedings 30th IEEE International Symposium on Multiple-Valued Logic (ISMVL 2000).

[217]  Jordi Carrabina,et al.  Mixed SW/SystemC SoC Emulation Framework , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[218]  Franco Fummi,et al.  Improving gate-level ATPG by traversing concurrent EFSMs , 2006, 24th IEEE VLSI Test Symposium.

[219]  Gerald J. Sussman,et al.  Forward Reasoning and Dependency-Directed Backtracking in a System for Computer-Aided Circuit Analysis , 1976, Artif. Intell..

[220]  Ronald L. Rivest The Necessity of Feedback in Minimal Monotone Combinational Circuits , 1977, IEEE Transactions on Computers.

[221]  Ahmed Amine Jerraya,et al.  Building fast and accurate SW simulation models based on hardware abstraction layer and simulation environment abstraction layer , 2003, 2003 Design, Automation and Test in Europe Conference and Exhibition.

[222]  Soonhoi Ha,et al.  Virtual synchronization for fast distributed cosimulation of dataflow task graphs , 2002, 15th International Symposium on System Synthesis, 2002..

[223]  Melvin A. Breuer,et al.  Digital systems testing and testable design , 1990 .

[224]  Janick Bergeron,et al.  Writing Testbenches: Functional Verification of HDL Models , 2000 .

[225]  Franco Fummi,et al.  FATE: a Functional ATPG to Traverse Unstabilized EFSMs , 2006, Eleventh IEEE European Test Symposium (ETS'06).

[226]  Jacob A. Abraham,et al.  A unified framework for design validation and manufacturing test , 1996, Proceedings International Test Conference 1996. Test and Design Validity.

[227]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..