Evaluation of infrastructure planning approaches: an analogy with medicine

This paper discusses the evaluation of new infrastructure planning approaches. These new planning approaches have been put forward in response to the challenges of deep uncertainty about the future. However, these approaches up till now have seen little real word applications. One important reason for this lack of application is that the efficacy of these approaches has not been established yet. In turn, this is due to the problem that there is no agreed upon method for proving the efficacy of a new planning approach. In this paper, we will draw an analogy to medical research and development in order to outline a methodology for establishing the efficacy of new planning approaches. We discuss how the well established methodology for evaluation new medical treatments can be adapted to evaluating new planning approaches. We illustrate the resulting evaluation methodology by outlining an evaluation strategy for a specific new planning approach. It is concluded that the well established methodology from medicine can successfully be used to inform the evaluation of infrastructure planning approaches

[1]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[2]  B. Flyvbjerg,et al.  Megaprojects and Risk: An Anatomy of Ambition , 2004, Perspectives on Politics.

[3]  Teresa Ribeiro,et al.  Technological Forecasting & Social Change Scenario planning in public policy : Understanding use , impacts and the role of institutional context factors ☆ , 2009 .

[4]  James S. Hodges,et al.  Is It You or Your Model Talking?: A Framework for Model Validation , 1992 .

[5]  Louis Albrechts,et al.  Strategic (Spatial) Planning Reexamined , 2004 .

[6]  Rpjm Rob Raven,et al.  Niche accumulation and hybridisation strategies in transition processes towards a sustainable energy system: An assessment of differences and pitfalls , 2007 .

[7]  Omar A. El Sawy,et al.  Assessing Information System Design Theory in Perspective: How Useful Was our 1992 Initial Rendition? , 2004 .

[8]  Richard de Neufville,et al.  Dynamic strategic planning for technology policy , 2000, Int. J. Technol. Manag..

[9]  Vincent Marchau,et al.  An Adaptive Approach to Implementing Innovative Urban Transport Solutions , 2008 .

[10]  Vijay K. Vaishnavi,et al.  Theory Development in Design Science Research: Anatomy of a Research Project , 2008 .

[11]  Paul Stephen Dempsey,et al.  Denver International Airport: Lessons Learned , 1997 .

[12]  Y. Ben-Haim Information-gap decision theory : decisions under severe uncertainty , 2001 .

[13]  Jonathan Cave,et al.  Cyber trust and crime prevention : gaining insight from three different futures , 2004 .

[14]  Aura Reggiani,et al.  Policy Analysis of Transport Networks , 2006 .

[15]  Robert J. Lempert,et al.  Do We Need Better Predictions to Adapt to a Changing Climate , 2009 .

[16]  Tom Reynolds,et al.  Airport systems planning, design, and management , 2003 .

[17]  R. Neufville Real Options: Dealing With Uncertainty in Systems Planning and Design , 2003 .

[18]  Carl Hosticka,et al.  Compass and Gyroscope: Integrating Science and Politics for the Environment , 1995 .

[19]  Martin Wachs,et al.  Transportation Planning, Climate Change, and Decisionmaking Under Uncertainty , 2008 .

[20]  H. Simon,et al.  The sciences of the artificial (3rd ed.) , 1996 .

[21]  Patricia G. J. Twaalfhoven,et al.  Towards a conceptual structure for evaluating policy analytic activities , 2001, Eur. J. Oper. Res..

[22]  Robert J. Lempert,et al.  Making Computational Social Science Effective , 2002 .

[23]  Steve Bankes Models as lab equipment: science from computational experiments , 2009, Comput. Math. Organ. Theory.

[24]  C. S. Holling Adaptive Environmental Assessment and Management , 2005 .

[25]  Jeroen C. J. H. Aerts,et al.  Research, part of a Special Feature on New Methods for Adaptive Water Management Managing Change toward Adaptive Water Management through Social Learning , 2007 .

[26]  George Wright,et al.  The origins and evolution of scenario techniques in long range business planning , 2005 .

[27]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[28]  Heinz Weihrich,et al.  The TOWS matrix—A tool for situational analysis , 1982 .

[29]  Sreeja Nair,et al.  Seven tools for creating adaptive policies , 2010 .

[30]  Michael Batty,et al.  Modelling and prediction in a complex world , 2005 .

[31]  R. McLain,et al.  Adaptive management: Promises and pitfalls , 1996, Environmental management.

[32]  Robert J Lempert,et al.  A new decision sciences for complex systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Alan L. Porter,et al.  Forecasting and Management of Technology , 1991 .

[34]  G. Busenberg,et al.  Learning in Organizations and Public Policy , 2001 .

[35]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[36]  Patrick van der Duin,et al.  Monitoring the future. Building an early warning system for the Dutch Ministry of Justice , 2010 .

[37]  Daniel D. Frey,et al.  Validation of design methods: lessons from medicine , 2006 .

[38]  Christopher L. Magee,et al.  Research agenda for an integrated approach to infrastructure planning, design and management , 2006, Int. J. Crit. Infrastructures.

[39]  Omar El Sawy,et al.  Building an Information System Design Theory for Vigilant EIS , 1992, Inf. Syst. Res..

[40]  David A. Tansik,et al.  Analysis for Public Decisions , 1976 .

[41]  D. Collingridge The social control of technology , 1980 .

[42]  H. Ansoff Corporate strategy : an analytic approach to business policy for growth and expansion , 1965 .

[43]  Celeste Varum,et al.  Directions in scenario planning literature – A review of the past decades , 2010 .

[44]  Steve Bankes,et al.  Exploratory Modeling for Policy Analysis , 1993, Oper. Res..

[45]  Warren E. Walker,et al.  Adaptive policies, policy analysis, and policy-making , 2001, Eur. J. Oper. Res..

[46]  George Wright,et al.  The limits of forecasting methods in anticipating rare events , 2010 .

[47]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[48]  R. Lempert,et al.  Identifying and evaluating robust adaptive policy responses to climate change for water management agencies in the American west , 2010 .

[49]  R. L. Henshel,et al.  Forecasting: An Appraisal for Policy-Makers and Planners. , 1978 .

[50]  Jeroen P. van der Sluijs,et al.  Operationalising a resilience approach to adapting an urban delta to uncertain climate changes , 2010 .

[51]  R. Lempert,et al.  Shaping the Next One Hundred Years: New Methods for Quantitative Long-Term Policy Analysis , 2003 .

[52]  Tamás Kristóf Is it possible to make scientific forecasts in social sciences , 2006 .

[53]  J. Dewey,et al.  The Public and its Problems , 1927 .

[54]  W. Thissen,et al.  A Framework for Identifying and Qualifying Uncertainty in Policy Making: The Case of Intelligent Transport Systems , 2007 .

[55]  Johan Schot,et al.  Experimenting for Sustainable Transport: The Approach of Strategic Niche Management , 2002 .

[56]  R.J.M. Hartog,et al.  Evaluation in Design-Oriented Research , 2005 .

[57]  Jacques Poot A Synthesis of Empirical Research on the Impact of Government onLong‐Run Growth , 2000 .

[58]  Vincent Marchau,et al.  Addressing deep uncertainty using adaptive policies: introduction to section 2 , 2010 .

[59]  Steven W. Popper,et al.  Natural Gas and Israel's Energy Future: A Strategic Analysis Under Conditions of Deep Uncertainty , 2009 .

[60]  Warren E. Walker,et al.  Adaptive Airport Strategic Planning , 2010, European Journal of Transport and Infrastructure Research.

[61]  Wil A. H. Thissen,et al.  Pilot Projects in Water Management , 2010 .

[62]  William M. Hix,et al.  Assumption-Based Planning: A Planning Tool for Very Uncertain Times , 1995 .

[63]  J. Dewar Assumption-Based Planning: The essence of Assumption-Based Planning , 2002 .

[64]  Igor S. Mayer,et al.  Games in a World of Infrastructures , 2003 .

[65]  Guillaume Burghouwt,et al.  Airline Network Development in Europe and its Implications for Airport Planning , 2007 .

[66]  Vincent Marchau,et al.  Dealing With Uncertainty in Implementing Advanced Driver Assistance Systems: An Adaptive Approach , 2003 .

[67]  Arthur C. Petersen,et al.  Planned adaptation in risk regulation: An initial survey of US environmental, health, and safety regulation , 2010 .

[68]  Bruce L. Golden,et al.  Analysis for Public Decisions (2nd ed.). , 1983 .

[69]  B. Agusdinata,et al.  Exploratory modeling and analysis: a promising method to deal with deep uncertainty , 2008 .

[70]  James S. Hodges,et al.  Six (Or So) Things You Can Do with a Bad Model , 1991, Oper. Res..

[71]  Reuben R. McDaniel,et al.  Uncertainty and surprise in complex systems : questions working with the unexpected , 2005 .