Validating The Realism and Representation of SCATS When Operating within Simulation

This paper introduces the challenge of validating the operation of a Sydney Coordinated Adaptive Traffic System (SCATS) installation within traffic simulation. The challenge is producing an appropriate validation methodology that provides stakeholders with confidence that modeling results are realistic and representative to the real-world installation. Modeling results that are realistic and representative are relevant and therefore defensible. The focus of this paper is to demonstrate an appropriate technique to validate the achieved realism and representation that resulted from a particular operation of a SCATS installation within simulation. The authors draw from further work done since that 2010 writing and present two topical aspects: (i) demonstration of a method to quantify the realism and representation of both the SCATS operation and the simulated traffic outcomes; and (ii) contrasting demonstration of unrealistic and unrepresentative outcomes; for a particular study. The authors highlight and discuss the associated risks of indefensible and irrelevance results that impose on the study. The authors use the example of a comprehensive study titled ‘SCATS and the Environment’ to provide a practical basis to support the claims made. This presentation provides a guide to modeling practitioners on the appropriate validation techniques to support the assessment of modeling studies that concern automated traffic control.