Input Space Coverage Matters

Testing is the most commonly used approach for software assurance, yet it remains as much judgment and art as science. We suggest that structural coverage measures must be supplemented with measures of input space coverage, providing a means of verifying that an adequate input model has been defined.

[1]  Elaine J. Weyuker,et al.  Theories of Program Testing and the Application of Revealing Subdomains , 1980, IEEE Transactions on Software Engineering.

[2]  Redge Bartholomew.  An industry proof-of-concept demonstration of automated combinatorial test , 2013, 2013 8th International Workshop on Automation of Software Test (AST).

[3]  John Joseph Chilenski,et al.  An Investigation of Three Forms of the Modified Condition Decision Coverage (MCDC) Criterion , 2001 .

[4]  D. Richard Kuhn,et al.  Software fault interactions and implications for software testing , 2004, IEEE Transactions on Software Engineering.

[5]  Matthias Grochtmann,et al.  Classification trees for partition testing , 1993, Softw. Test. Verification Reliab..

[6]  Yu Lei,et al.  Practical Combinatorial Testing , 2010 .

[7]  Lori A. Clarke,et al.  Partition Analysis: A Method Combining Testing and Verification , 1985, IEEE Transactions on Software Engineering.

[8]  T. Ferrell,et al.  RTCA DO-178C/EUROCAE ED-12C and the Technical Supplements , 2014 .

[9]  Koushik Sen,et al.  CUTE: a concolic unit testing engine for C , 2005, ESEC/FSE-13.

[10]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[11]  Hoyt Lougee,et al.  SOFTWARE CONSIDERATIONS IN AIRBORNE SYSTEMS AND EQUIPMENT CERTIFICATION , 2001 .

[12]  Dimitris E. Simos,et al.  CAMETRICS: A Tool for Advanced Combinatorial Analysis and Measurement of Test Sets , 2018, 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[13]  Raghu Kacker,et al.  A method for analyzing system state-space coverage within a t-wise testing framework , 2010, 2010 IEEE International Systems Conference.

[14]  Jeff Yu Lei,et al.  Measuring and specifying combinatorial coverage of test input configurations , 2015, Innovations in Systems and Software Engineering.

[15]  Luciano Baresi,et al.  An Introduction to Software Testing , 2006, FoVMT.

[16]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[17]  Koushik Sen,et al.  DART: directed automated random testing , 2005, PLDI '05.

[18]  Jeff Yu Lei,et al.  Combinatorial Coverage Measurement Concepts and Applications , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops.

[19]  Sigrid Eldh.  Software Testing Techniques , 2007 .

[20]  Yu Lei,et al.  Combinatorial coverage as an aspect of test quality , 2015 .

[21]  Lori A. Clarke,et al.  A program testing system , 1976, ACM '76.