Optimal sample size allocation for integrated test scheme

Integrated test scheme (ITS) make comprehensive use of simulation and field test to evaluate system performance, which takes on merits of low cost, full-scale assessment, and high precision. Sample size determination (SSD) methods for ITS are analyzed, which reveals the problem and contradiction in classical method and Bayesian method using standard power prior for design. Design effect of experiment is proposed considering the influence of prior sample size, which is used for elicitation of modified power prior for SSD of ITS. Taking average posterior variance for parameter of interest as the output precision, optimization equation for SSD of ITS under required posterior precision constraint is designed, whose effectiveness is illustrated with a utilization example.

[1]  Sankaran Mahadevan,et al.  Validation and error estimation of computational models , 2006, Reliab. Eng. Syst. Saf..

[2]  Edward Kraft.  Integrated Test and Evaluation - A knowledge-based approach to system development , 1995 .

[3]  M. A. Best.  Bayesian Approaches to Clinical Trials and Health‐Care Evaluation , 2005 .

[4]  M. Nassar,et al.  On Bayesian sample size determination , 2011 .

[5]  J. Ibrahim,et al.  Power prior distributions for regression models , 2000 .

[6]  Fulvio De Santis,et al.  Using historical data for Bayesian sample size determination , 2007 .

[7]  Yuyan Duan,et al.  A Modified Bayesian Power Prior Approach with Applications in Water Quality Evaluation , 2005 .

[8]  C. J. Adcock,et al.  The choice of sample size and the method of maximum expected utility—comments on the paper by Lindley , 1997 .

[9]  C. Adcock.  Sample size determination : a review , 1997 .

[10]  Osman Balci,et al.  Verification, Validation, and Testing , 2007 .

[11]  Fulvio De Santis,et al.  Power Priors and Their Use in Clinical Trials , 2006 .

[12]  Osman Balci,et al.  Verification, Validation And Accreditation Of Simulation Models , 1997, Winter Simulation Conference Proceedings,.

[13]  William T. Cousins,et al.  Demonstration of an Integrated Test and Evaluation (IT&E) Process for Airframe-Propulsion Systems as Applied to a Current Weapon System Program * , 2010 .

[14]  Joseph G Ibrahim,et al.  Bayesian Design of Noninferiority Trials for Medical Devices Using Historical Data , 2011, Biometrics.

[15]  D. Spiegelhalter,et al.  Bayesian Approaches to Clinical Trials and Health-Care Evaluation: Spiegelhalter/Clinical Trials and Health-Care Evaluation , 2004 .

[16]  K. Murphy,et al.  Statistical Power Analysis: A Simple and General Model for Traditional and Modern Hypothesis Tests, Second Ediction , 1998 .

[17]  Douglas F. Kaupa.  Planning for the KC -X Integrated Test , 2009 .