A methodology is presented which allows comparison between models constructed under different modeling paradigms. Consider two models that exist to study different aspects of the same system, specifically Air Mobility Command's strategic airlift system. One model simulates a fleet of aircraft moving a given combination of cargo and passengers from an onload point to an offload point. The second model is a linear program that optimizes aircraft and route selection given cargo and passenger requirements in order to minimize late and nondeliveries. Further, the optimization model represents a more aggregated view of the airlift system than does the simulation. The two models do not have immediately comparable input or output structures, which complicates comparisons between the two models. We develop a methodology that structures this comparison and use it to compare the two large-scale models described above. Further, our technique has the fortunate byproduct of improving the fidelity of the models through a series of iterative refinements of the input to each model based on the output of the other. Models that compare favorably with regard to our methodology are deemed covalid models.
[1]
Robert G. Sargent.
Some subjective validation methods using graphical displays of data
,
1996,
Winter Simulation Conference.
[2]
Kenneth W. Bauer,et al.
Covalidation of dissimilarly structured models
,
1997,
WSC '97.
[3]
George E. P. Box,et al.
Empirical Model‐Building and Response Surfaces
,
1988
.
[4]
Jack P. C. Kleijnen,et al.
EUROPEAN JOURNAL OF OPERATIONAL
,
1992
.
[5]
David P. Morton,et al.
Optimizing Military Airlift
,
2002,
Oper. Res..
[6]
Averill M. Law,et al.
Simulation Modeling & Analysis
,
1991
.
[7]
Osman Balci.
Validation, verification, and testing techniques throughout the life cycle of a simulation study
,
1994,
WSC '94.
[8]
Heston R. Hicks,et al.
Comparison of models: ex post facto validation/acceptance?
,
1992,
WSC '92.