Selection bias in build-operate-transfer transportation project appraisals

Recent empirical studies have found widespread inaccuracies in traffic forecasts despite the fact that travel demand forecasting models have been significantly improved over the past few decades. We suspect that an intrinsic selection bias may exist in the competitive project appraisal process, in addition to the many other factors that contribute to inaccurate traffic forecasts. In this paper, we examine the potential for selection bias in the governmental process of Build-Operate-Transfer (BOT) transportation project appraisals. Although the simultaneous consideration of multiple criteria is typically used in practice, traffic flow estimate is usually a key criterion in these appraisals. For the purposes of this paper, we focus on the selection bias associated with the highest flow estimate criterion. We develop two approaches to quantify the level and chance of inaccuracy caused by selection bias: the expected value approach and the probability approach. The expected value approach addresses the question “to what extent is inaccuracy caused by selection bias?”. The probability approach addresses the question “what is the chance of inaccuracy due to selection bias?”. The results of this analysis confirm the existence of selection bias when a government uses the highest traffic forecast estimate as the priority criterion for BOT project selection. In addition, we offer some insights into the relationship between the extent/chance of inaccuracy and other related factors. We do not argue that selection bias is the only reason for inaccurate traffic forecasts in BOT projects; however, it does appear that it could be an intrinsic factor worthy of further attention and investigation.

[1]  Kara M. Kockelman,et al.  Understanding and Accommodating Risk and Uncertainty in Toll Road Projects , 2009 .

[2]  Morten Skou Nicolaisen,et al.  Ex-Post Evaluations of Demand Forecast Accuracy: A Literature Review , 2014 .

[3]  Nicanor R. Roxas,et al.  FORECASTING INACCURACIES IN TRANSPORTATION PROJECTS IN SELECTED SOUTH EAST ASIAN COUNTRIES , 2008 .

[4]  D. N. P. Murthy,et al.  Reliability: Modeling, Prediction, and Optimization , 2000 .

[5]  Hai Yang,et al.  HIGHWAY PRICING AND CAPACITY CHOICE IN A ROAD NETWORK UNDER A BUILD-OPERATE-TRANSFER SCHEME , 2000 .

[6]  J. Heckman Sample selection bias as a specification error , 1979 .

[7]  Anthony Chen,et al.  Analysis of regulation and policy of private toll roads in a build-operate-transfer scheme under demand uncertainty , 2007 .

[8]  Jonas Eliasson,et al.  Cost overruns and demand shortfalls – Deception or selection? , 2013 .

[9]  D. Levinson,et al.  Post-Construction Evaluation of Forecast Accuracy , 2009 .

[10]  Zheng Li,et al.  Toll Roads in Australia: An Overview of Characteristics and Accuracy of Demand Forecasts , 2010 .

[11]  Kara M. Kockelman,et al.  The propagation of uncertainty through travel demand models: An exploratory analysis , 2000 .

[12]  J. Jensen Sur les fonctions convexes et les inégalités entre les valeurs moyennes , 1906 .

[13]  Zhong Zhou,et al.  Comparative Analysis of Three User Equilibrium Models Under Stochastic Demand , 2008 .

[14]  John Preston,et al.  Twenty-one sources of error and bias in transport project appraisal , 1998 .

[15]  Petter Næss,et al.  Roads to Nowhere: The Accuracy of Travel Demand Forecasts for Do-Nothing Alternatives , 2015 .

[16]  Søren L. Buhl,et al.  How (In)accurate Are Demand Forecasts in Public Works Projects?: The Case of Transportation , 2005, 1303.6654.

[17]  Anthony Chen,et al.  Effects of Regulation on Highway Pricing and Capacity Choice of a Build-Operate-Transfer Scheme , 2007 .

[18]  R. Bain Error and optimism bias in toll road traffic forecasts , 2009 .

[19]  Hong Kam Lo,et al.  Modeling distribution tail in network performance assessment: A mean-excess total travel time risk measure and analytical estimation method , 2014 .