Extreme quantile estimation using order statistics with minimum cross-entropy principle

Abstract The paper presents a general approach to the estimation of the quantile function of a non-negative random variable using the principle of minimum cross-entropy (CrossEnt) subject to constraints specified in terms of expectations of order statistics estimated from observed data. Traditionally CrossEnt is used for estimating the probability density function under specified moment constraints. In such analyses, consideration of higher order moments is important for accurate modelling of the distribution tail. Since the higher order (>2) moment estimates from a small sample of data tend to be highly biased and uncertain, the use of CrossEnt quantile estimates in extreme value analysis is fairly limited. The present paper is an attempt to overcome this problem via the use of probability weighted moments (PWMs), which are essentially the expectations of order statistics. In contrast with ordinary statistical moments, higher order PWMs can be accurately estimated from small samples. By interpreting a PWM as the moment of quantile function, the paper derives an analytical form of quantile function using the CrossEnt principle. Monte Carlo simulations are performed to assess the accuracy of CrossEnt quantile estimates obtained from small samples.