Engaging Nash-Sutcliffe Efficiency and Model Efficiency Factor Indicators in Selecting and Validating Effective Light Rail System Operation and Maintenance Cost Models

A set of LR (light rail) transit O&M (operation and maintenance) cost models were derived as functions of system attributes, namely Directional-Route-Miles, Train-Revenue-Hours, Train-Revenue-Miles, Peak Passenger Cars and Annual Passenger Trips. These models were developed based on the data of 12 LR facilities in the United States from 2004~2008 reported on the National Transit Database. The models were then validated with newer data of the same systems from 2009~2011. Instead of using the traditional R-squared, NSE (Nash-Sutcliffe efficiency) was employed for model selection. Furthermore, MEF (model efficiency factor) indicators were used to validate model's performance. When compared to the actual data, the prediction ability of these new models was superior to those of previously developed PFM (power factor models).

[1]  Gordon J. Fielding,et al.  PERFORMANCE EVALUATION FOR BUS TRANSIT , 1985 .

[2]  Bernard A. Engel,et al.  USE OF SWAT TO COMPUTE GROUNDWATER TABLE DEPTH AND STREAMFLOW IN THE MUSCATATUCK RIVER WATERSHED , 2005 .

[3]  J R Ryan,et al.  PROCEDURES AND TECHNICAL METHODS FOR TRANSIT PROJECT PLANNING. UPDATE 1990 , 1990 .

[4]  R. McCuen,et al.  Evaluation of the Nash-Sutcliffe Efficiency Index , 2006 .

[5]  A. Dezetter,et al.  Selection of calibration objective fonctions in the context of rainfall-ronoff modelling in a Sudanese savannah area , 1991 .

[6]  Jay L. Devore,et al.  Probability and statistics for engineering and the sciences , 1982 .

[7]  Jeffrey G. Arnold,et al.  Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations , 2007 .

[8]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[9]  S. Jain,et al.  Fitting of Hydrologic Models: A Close Look at the Nash–Sutcliffe Index , 2008 .

[10]  J. Arnold,et al.  HYDROLOGICAL MODELING OF THE IROQUOIS RIVER WATERSHED USING HSPF AND SWAT 1 , 2005 .

[11]  A. Shirmohammadi,et al.  EVALUATION OF THE SWAT MODEL’S HYDROLOGY COMPONENT IN THE PIEDMONT PHYSIOGRAPHIC REGION OF MARYLAND , 2004 .

[12]  Albert Gan,et al.  A Methodology for Performance Measurement and Peer Comparison in the Public Transportation Industry , 2010 .

[13]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[14]  Obed Pasha,et al.  Does Performance Management Lead to Better Outcomes? Evidence from the U.S. Public Transit Industry , 2013 .