A Methodology for Evaluating PSI E-infrastructures Based on Multiple Value Models

The trend of opening government data, in order to be used for scientific, commercial and political purposes, has resulted in the development of numerous e-infrastructures providing public sector information (PSI). The big investments that have been made in this direction necessitate a deeper understanding and assessment of the value they produce. This paper presents a methodology for evaluating PSI e-infrastructures, which is based on the estimation of multiple value models corresponding to their main stakeholder groups: data users and data providers. Each value model consists of several value dimensions and their corresponding value measures, organized in three levels (associated with efficiency, effectiveness and future behaviour), and also the relations among them. The proposed methodology allows a comprehensive assessment of the various types of value generated by a PSI e-infrastructure for each stakeholder group, and also the interconnections among them. This enables a better understanding of the whole value generation mechanism and a rational definition of improvements priorities.

[1]  P. Wouters,et al.  What is the matter with e-science: thinking aloud about informatisation in knowledge creation , 2006 .

[2]  Leslie P. Willcocks,et al.  Investing in information systems: evaluation and management , 1995 .

[3]  Frank F. Land,et al.  Moving IS evaluation forward: learning themes and research issues , 1999, J. Strateg. Inf. Syst..

[4]  Martin Wetzels,et al.  A meta-analysis of the technology acceptance model: Investigating subjective norm and moderation effects , 2007, Inf. Manag..

[5]  M. Fassnacht,et al.  Quality of Electronic Services , 2006 .

[6]  Peter E.D. Love,et al.  Information systems evaluation: A crisis of understanding , 2008 .

[7]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[8]  W A Wulf,et al.  The collaboratory opportunity. , 1993, Science.

[9]  Sandeep Grover,et al.  Quantitative Evaluation of Website Quality Dimension for Web 2.0 Environment , 2011 .

[10]  Angappa Gunasekaran,et al.  Quantitative and qualitative approaches to information systems evaluation , 2006, Eur. J. Oper. Res..

[11]  Daniel Atkins,et al.  Revolutionizing Science and Engineering Through Cyberinfrastructure: Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure , 2003 .

[12]  Ernesto Tavoletti,et al.  MEPSIR:Measuring European Public Sector Information Resources , 2006 .

[13]  Craig Standing,et al.  An interpretive approach to evaluating information systems: A content, context, process framework , 2006, Eur. J. Oper. Res..

[14]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[15]  Zahir Irani,et al.  Information systems evaluation: navigating through the problem domain , 2002, Inf. Manag..

[16]  I. Ajzen.  The theory of planned behavior , 1991 .

[17]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[18]  M. Nentwich.  Cyberscience: Research in the Age of the Internet , 2003 .

[19]  Jie Lu,et al.  Cost benefit factor analysis in e‐services , 2003 .

[20]  R. Hirschheim,et al.  Analysing information systems evaluation: another look at an old problem , 1998 .

[21]  Marjan Hericko,et al.  Towards an e-Service Knowledge System for Improving the Quality and Adoption of e-Services , 2009, Bled eConference.

[22]  Jennifer E. Rowley,et al.  An analysis of the e-service literature: towards a research agenda , 2006, Internet Res..

[23]  Euripidis Loukis,et al.  Transforming e-services evaluation data into business analytics using value models , 2012, Electron. Commer. Res. Appl..

[24]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[25]  Angappa Gunasekaran,et al.  Information technology and systems justification: A review for research and applications , 2006, Eur. J. Oper. Res..

[26]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Independent Variables , 1992, J. Manag. Inf. Syst..

[27]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[28]  Peter B. Seddon.  A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[29]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[30]  Kevin Crowston,et al.  Technology adoption and use theory review for studying scientists' continued use of cyber-infrastructure , 2011, ASIST.

[31]  Leslie P. Willcocks,et al.  Delivering IT And E-Business Value , 2001 .