Automating software module testing for FAA certification

Structural testing, also called code-based or white-box testing, is performed for the purpose of exercising the code thoroughly. The code coverage measurements are used to evaluate the effectiveness of the test cases toward this goal. Manual, code-based testing is cumbersome and time-consuming. Automation provides help in selecting test data, applying those test cases to the software, and deciding whether a program has been tested enough by providing coverage metrics. This paper describes an automated module testing process for software written in Ada using a tool set called Test Set Editor (TSE). TSE consists of a proprietary set of programs which work in combination with Microsoft Excel spreadsheet program and home grown test scripts written in Tcl/tk. Use of the tool set is shown to yield significant cost savings in constructing structural tests needed to satisfy FAA certification requirements for safety-critical software.