Automated software testing for the common operating environment