Lessons learnt on Requirement Analyses to establish new model systems: Prerequisites to assure model use towards policy outcome

The objective of the paper is to evaluate the applied non-standardised Model Requirement Analysis (MRA). Using the presented methods and results of the MRA, we discuss the suitability for appropriate ways to improve applied methods using the example of the Sustainability Impact Assessment Tools (SIAT). Special focus is given to the prerequisites of project design to assure model use towards model outcome. The applied methods of the MRA consist of evolutionary prototyping, which provides a way to structure the subsequent group discussions with end-users. The results first summarise the conducted interactions with potential end-users and evaluate the usefulness of conducting MRA for each end-user meeting. A direct outcome of the MRA is the identification of four categories of requirements for the SIAT design: (a) Spatial, time and thematic integration, (b) technical performance and system advancements, (c) quality assurance of data and model systems results and (d) organisational linkages for model system embedding. We give a number of reasons why the undertaken development process of SIAT was not sufficient for actual operational use towards outcome at the level of policy decision making. A number of recommendations and rules for stakeholder involvement and development methods are suggested in the conclusions.

[1]  Katharina Helming,et al.  Ex ante impact assessment of land use changes in European regions — the SENSOR approach , 2008 .

[2]  Marco Torchiano,et al.  Talking tests: an empirical assessment of the role of fit acceptance tests in clarifying requirements , 2007, IWPSE '07.

[3]  Demetrios Karis,et al.  Usability problem identification using both low- and high-fidelity prototypes , 1996, CHI.

[4]  Peter Checkland,et al.  A role for soft systems methodology in information systems development , 1995 .

[5]  João Araújo,et al.  An evolutionary model of requirements correctness with early aspects , 2007, IWPSE '07.

[6]  Rajesh Mirani,et al.  Policy implications of organizational decision support systems , 1996, Proceedings of HICSS-29: 29th Hawaii International Conference on System Sciences.

[7]  Gianfranco Lamperti,et al.  Software Prototyping in Data and Knowledge Engineering , 1999 .

[8]  A. Veldkamp,et al.  Analysis of the effects of land use change on protected areas in the Philippines , 2006 .

[9]  Rudolf Vetschera Decision Support Systems in Networked Organizations , 1997 .

[10]  Dorothée Brécard,et al.  Macro-economic consequences of European research policy: Prospects of the Nemesis model in the year 2030 , 2006 .

[11]  Katharina Helming,et al.  Transfer into decision support: The Sustainability Impact Assessment Tool (SIAT) , 2008 .

[12]  M. Donatelli,et al.  Integrated assessment of agricultural systems: a component - based framework for the European Union (Seamless) , 2008 .

[13]  M. Pérez-Soba,et al.  Sustainability Impact Assessment of land use policies , 2008 .

[14]  Alan M. Davis,et al.  Operational prototyping: a new development approach , 1992, IEEE Software.

[15]  Timo Karjalainen,et al.  Integrated forestry assessments for climate change impacts , 2002 .

[16]  D. E. Reeve,et al.  Gis, Organisations and People: A Socio-Technical Approach , 1999 .

[17]  D. Norse,et al.  Links between science and policy making , 2000 .

[18]  Jerome R. Ravetz,et al.  Uncertainty, complexity and post-normal science , 1994 .

[19]  Paul Jen-Hwa Hu,et al.  Evaluation of user interface designs for information retrieval systems: a computer-based experiment , 1999, Decis. Support Syst..

[20]  D. C. van der Werf,et al.  Model documentation for the European Forest Information Scenario model (EFISCEN 3.1.3) , 2007 .

[21]  Marco A. Janssen,et al.  The roles of computer models in the environmental policy life cycle , 2002 .

[22]  Peter Checkland,et al.  Information, Systems, And Information Systems , 1997 .