Evaluating the application of the multi-view spatial data infrastructure assessment framework

As a response to the growing interest in assessing Spatial Data Infrastructures (SDIs) the Multi-view SDI assessment framework has been proposed. The Multi-view SDI assessment framework collects multiple assessment approaches and methods with the aim to assess many different aspects of SDI in a comprehensive and unbiased way. Despite the potential strengths of the framework, its complex design raises concerns about its usability and applicability for SDI assessment. In this article we evaluate the application of the Multi-view SDI assessment framework. In addition, we ask the potential users of the framework to evaluate its applicability to assess SDIs. The results show that the framework could be applied to 21 National SDIs. Evaluation of the application process reveals that the completeness of assessment data and time needed to measure indicators depends strongly on the assessment methods used. It is recommended to use those methods that need less time to measure assessment indicators. The results also show that a significant part of the measurements could not be done due to survey questions not being filled in by the respondents. The results also show that the users tend to agree with the applicability of the Multi-view SDI assessment framework to assess SDIs.

[1]  Abbas Rajabifard,et al.  Future directions for Spatial Data Infrastructure Assessment , 2008 .

[2]  J. Orshoven,et al.  Spatial Data Infrastructures in Europe: State of play spring 2003 , 2003 .

[3]  Michael Scriven,et al.  The Logic of Evaluation , 2007 .

[4]  มาเรียม นิลพันธุ์,et al.  Evaluation Theory, Models, & Applications , 2013 .

[5]  Arnold Bregt,et al.  Multi-view SDI Assessment Framework , 2007, Int. J. Spatial Data Infrastructures Res..

[6]  Arnold Bregt,et al.  Cross‐agency coordination in the shadow of hierarchy: ‘joining up’ government geospatial information systems , 2009, Int. J. Geogr. Inf. Sci..

[7]  M. Scriven.  Evaluation thesaurus, 4th ed. , 1991 .

[8]  W. Wiersma.  Evaluation Theory, Models, & Applications , 2008 .

[9]  Arnold K. Bregt,et al.  Worldwide impact assessment of spatial data clearinghouses , 2007 .

[10]  Joep Crompvoets,et al.  Infraestructuras de Datos Espaciales en Iberoamérica y el Caribe , 2007 .

[11]  Abbas Rajabifard,et al.  Assessing the worldwide developments of national spatial data clearinghouses , 2004, Int. J. Geogr. Inf. Sci..

[12]  Daniel Steudler,et al.  Evaluation of land administration systems , 2004 .

[13]  Abbas Rajabifard,et al.  Spatial Data Infrastructures: Concept, Nature and SDI Hierarchy , 2003 .

[14]  Katleen Janssen,et al.  INSPIRE State of Play: generic approach to assess the status of NSDIs , 2008 .

[15]  Ian Masser.  GIS Worlds: Creating Spatial Data Infrastructures , 2005 .

[16]  Orlando Rodriguez-Pabon,et al.  Cadre théorique pour l'évaluation des infrastructures d'information géospatiale , 2005 .

[17]  P. Cilliers,et al.  Complexity and post-modernism: understanding complex systems , 1999 .

[18]  Abbas Rajabifard,et al.  A Multi-view Framework to Assess Spatial Data Infrastructures , 2008 .

[19]  Daniel L. Stufflebeam,et al.  The Metaevaluation Imperative , 2001 .

[20]  J. Frane.  Some simple procedures for handling missing data in multivariate analysis , 1976 .

[21]  Ian Masser,et al.  All shapes and sizes: the first generation of national spatial data infrastructures , 1999, Int. J. Geogr. Inf. Sci..

[22]  Arnold Bregt,et al.  Understanding how and why practitioners evaluate SDI performance , 2006, Int. J. Spatial Data Infrastructures Res..

[23]  Theresa A. Pardo,et al.  Multimethod Approaches to Understanding the Complexity of e-Government , 2006, Int. J. Comput. Syst. Signals.

[24]  Joep Crompvoets.  National Spatial Data Clearinghouses: Worldwide development and impact , 2006 .

[25]  Arnold K. Bregt,et al.  Clearinghouse Suitability Index , 2008 .

[26]  Glenda H. Eoyang,et al.  Evaluation in a Complex Adaptive System , 1998 .

[27]  W. H. Erik de Man.  Understanding SDI; complexity and institutionalization , 2006, Int. J. Geogr. Inf. Sci..

[28]  J Harlan,et al.  Research and Theory in Advancing Spatial Data Infrastructure Concepts , 2007 .

[29]  Bastiaan van Loenen,et al.  How to assess the success of National Spatial Data Infrastructures? , 2005, Comput. Environ. Urban Syst..

[30]  Michael Scriven,et al.  An Introduction to Meta-Evaluation. , 1969 .

[31]  W. Neuman,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2002 .

[32]  A. Rajabifard.  Diffusion of regional spatial data infrastructures: with particular reference to Asia and the Pacific , 2002 .

[33]  R. Kent,et al.  Data Construction and Data Analysis for Survey Research , 2001 .

[34]  Arnold Bregt,et al.  Spatial data infrastructures as complex adaptive systems , 2010, Int. J. Geogr. Inf. Sci..

[35]  Richard Groot,et al.  Spatial data infrastructure (SDI) for sustainable land management , 1997 .

[36]  I. Masser.  Building European Spatial Data Infrastructures , 2007 .

[37]  P. Georgiadou,et al.  Spatial data infrastructure SDI and e-governance : a quest for appropriate evaluation approaches , 2006 .

[38]  Chris L. S. Coryn,et al.  Evaluation Theory, Models, and Applications , 2007 .

[39]  Arnold K. Bregt,et al.  National Spatial Data Clearinghouses , 2007 .

[40]  Frances P Lawrenz,et al.  Concurrent Meta-Evaluation , 2008 .

[41]  J. Huisman.  The Netherlands , 1996, The Lancet.

[42]  Hanne Foss Hansen,et al.  Choosing Evaluation Models , 2005 .

[43]  H. Bernard.  Research Methods in Anthropology: Qualitative and Quantitative Approaches , 1988 .

[44]  Herbert J. Walberg,et al.  The International encyclopedia of educational evaluation , 1990 .

[45]  Daniel L. Stufflebeam,et al.  Introduction to Evaluation , 1985 .

[46]  Yoichi Hirashima,et al.  Recursive Filter Design for Estimating Time Varying Multijoint Human Arm Viscoelasticity , 2006, Int. J. Comput. Syst. Signals.