Applications of stochastic simulation in two-stage multiple comparisons with the best problem and time average variance constant estimation

APPLICATIONS OF STOCHASTIC SIMULATION IN TWO-STAGE MULTIPLE COMPARISONS WITH THE BEST PROBLEM AND TIME AVERAGE VARIANCE CONSTANT ESTIMATION by Dibyendu Chakrabarti In this dissertation, we study two problems. In the first part, we consider the two-stage methods for comparing alternatives using simulation. Suppose there are a finite number of alternatives to compare, with each alternative having an unknown parameter that is the basis for comparison. The parameters are to be estimated using simulation, where the alternatives are simulated independently. We develop two-stage selection and multiple-comparison procedures for simulations under a general framework. The assumptions are that each alternative has a parameter estimation process that satisfies a randomtime-change central limit theorem (CLT), and there is a weakly consistent variance estimator (WCVE) for the variance constant appearing in the CLT. The framework encompasses comparing means of independent populations, functions of means, and steady-state means. One problem we consider of considerable practical interest and not handled in previous work on two-stage multiple-comparison procedures is comparing quantiles of alternative populations. We establish the asymptotic validity of our procedures as the prescribed width of the confidence intervals or indifference-zone parameter shrinks to zero. Also, for the steady-state simulation context, we compare our procedures based on WCVEs with techniques that instead use standardized time series methods. In the second part, we propose a new technique of estimating the variance parameter of a wide variety of stochastic processes. This new technique is better than the existing techniques for some standard stochastic processes in terms of bias and variance properties, since it reduces bias at the cost of no significant increase in variance. APPLICATIONS OF STOCHASTIC SIMULATION IN TWO-STAGE MULTIPLE COMPARISONS WITH THE BEST PROBLEM AND TIME AVERAGE VARIANCE CONSTANT ESTIMATION by Dibyendu Chakrabarti A Dissertation Submitted to the Faculty of New Jersey Institute of Technology in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science Department of Computer Science, NJIT