AN APPROACH FOR VERIFICATION AND VALIDAT ION OF THE ENVIRONMENTAL DESIGN SPACE

As part of the efforts to better assess the effect of aviation on the environment, the need for an improved understanding of noise, emissions, and fuel burn interdependencies has been recognized. A suite of analysis tools has been developed by the FAA, in conjunction with NASA and Transport Canada to inform environmental policy making and help shape the future of air transportation. As part of this suite, the Environmental Design Space (EDS) is tasked with the evaluation of the impact of new technologies on vehicle performance through simulation-based analysis of engines and airframes. To ensure the credibility of the EDS model, the assumptions, methodologies, and results must be reviewed through a formal, repeatable, and transparent assessment. This paper outlines the challenges faced, and the approach taken, in the assessment of the EDS model. The development process is divided into three distinct phases. The calibration process demonstrates the ability of the EDS model to reproduce representative aircraft. Using only public domain data, a combination of input parameters is established to approximate existing engines and airframes. The sensitivity analysis explores the relationship between model inputs and outputs while aiding the verification of physical trends. A methodology for variable screening and subsequent determination of input settings is established. Finally, the trade space exploration allows for the determination of a fleet of aircraft that represents the technology space through Pareto-front identification and selection. In each phase, error and uncertainty are quantified and propagated to communicate the probabilistic results of EDS to the other tools within the suite. Future work will focus on the details of implementing the approach for development and assessment.

[1]  W. L. Oberkampf,et al.  Bibliography for Verification and Validation in Computational Simulations , 1998 .

[2]  O. Heinisch,et al.  Steel, R. G. D., and J. H. Torrie: Principles and Procedures of Statistics. (With special Reference to the Biological Sciences.) McGraw‐Hill Book Company, New York, Toronto, London 1960, 481 S., 15 Abb.; 81 s 6 d , 1962 .

[3]  Christopher A. Mattson,et al.  Pareto Frontier Based Concept Selection Under Uncertainty, with Visualization , 2005 .

[4]  Timothy G. Trucano,et al.  General Concepts for Experimental Validation of ASCI Code Applications , 2002 .

[5]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[6]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[7]  Michael S. Eldred,et al.  OVERVIEW OF MODERN DESIGN OF EXPERIMENTS METHODS FOR COMPUTATIONAL SIMULATIONS , 2003 .

[8]  Karl Stengel,et al.  The eleven steps in validation, verification, and accreditation (VV&A) , 2000 .

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[11]  Michelle Kirby,et al.  Impact of Sampling Technique Selection on the Creation of Response Surface Models , 2004 .

[12]  J. Penner,et al.  Aviation and the Global Atmosphere , 1999 .

[13]  Ching-Lai Hwang,et al.  Group decision making under multiple criteria , 1987 .

[14]  Garret N. Vanderplaats,et al.  Numerical optimization techniques for engineering design , 1999 .

[15]  Jorge de Luis,et al.  A PROCESS FOR THE QUANTIFICATION OF AIRCRAFT NOISE , 2008 .

[16]  Dimitri N. Mavris,et al.  Economic Uncertainty Assessment Using a Combined Design of Experiments/Monte Carlo Simulation Approach with Application to an HSCT , 1995 .

[17]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[18]  T. Trucano,et al.  Verification, Validation, and Predictive Capability in Computational Engineering and Physics , 2004 .

[19]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[20]  Saul I. Gass,et al.  An Assessment Procedure for Simulation Models: A Case Study , 1991, Oper. Res..

[21]  Michelle R. Kirby,et al.  A Methodology for Technology Identification, Evaluation, and Selection in Conceptual and Prelimina , 2001 .