Extending the UML Testing Profile with a Fine-Grained Test Logging Model

Since 2013, a working group at OMG has worked on a significant revision of the UML Testing Profile. In June 2017, the OMG eventually released the beta version of the UML Testing Profile 2. It offers test-specific concepts that support the specification of test automation architectures in a model-driven way. Whereas the automation of test design and test execution activities are well supported by the UML Testing Profile, its test logging capability is limited to capture merely the most important information of a test execution run, i.e., the test verdict or timestamps for start and end of a test run. This restriction wastes potential for automated test evaluation or further information such as trend analysis. A fine-grained test logging facility tightly integrated into the UML Testing Profile would enable integrating test execution details of heterogeneous test execution systems based on a platform-independent language. This paper discusses the deficiencies of the UML Testing Profile concerning test logging and suggests an extension to the standard to capture all relevant information of a test execution run. We intend to suggest the described test logging facility to the respective OMG working group as an official extension of the UML Testing Profile.