Assessment of financial returns on investments in cyberinfrastructure facilities: A survey of current methods

In recent years, considerable attention has been given to assessing the value of investments in cyberinfrastructure (CI). This paper includes a survey of current methods for the assessment of financial returns on investment (ROI) in CI. Applying the financial concept of ROI proves challenging with regard to a service that, in most academic environments, does not generate a "sold amount" such as one would find in the buying and selling of stocks. The paper concludes with a discussion of future research directions and challenges in the assessment of financial ROI in CI. This work is intended less as a definitive guide than as a starting point for further exploration in the assessment of CI's value for scientific research.

[1]  Christopher D. Gerrard,et al.  Sourcebook for evaluating global and regional partnership programs : indicative principles and standards , 2007 .

[2]  Geoffrey C. Fox,et al.  Pervasive Technology Institute Annual Report: Research Innovations and Advanced Cyberinfrastructure Services in Support of IU Strategic Goals During FY 2016 , 2016 .

[3]  Nancy Wilkins-Diehr,et al.  Cyberinfrastructure, Cloud Computing, Science Gateways, Visualization, and Cyberinfrastructure Ease of Use , 2018 .

[4]  James C. Browne,et al.  Open XDMoD: A Tool for the Comprehensive Management of High-Performance Computing Resources , 2015, Computing in Science & Engineering.

[5]  Katy Börner,et al.  XD Metrics on Demand Value Analytics: Visualizing the Impact of Internal Information Technology Investments on External Funding, Publications, and Collaboration Networks , 2018, Front. Res. Metr. Anal..

[6]  Moez Limayem,et al.  High Performance Computing Instrumentation and Research Productivity in U.S. Universities , 2010, HiPC 2010.

[7]  Gregor von Laszewski,et al.  Peer Comparison of XSEDE and NCAR Publication Data , 2015, 2015 IEEE International Conference on Cluster Computing.

[8]  Gregor von Laszewski,et al.  TAS view of XSEDE users and usage , 2015, XSEDE.

[9]  Craig A. Stewart,et al.  A PetaFLOPS Supercomputer as a Campus Resource: Innovation, Impact, and Models for Locally-Owned High Performance Computing at Research Colleges and Universities , 2016, SIGUCCS.

[10]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .

[11]  T. Virdee.  The CMS Experiment at the LHC , 1999 .

[12]  Ian T. Foster,et al.  Jetstream: a self-provisioned, scalable science and engineering cloud environment , 2015, XSEDE.

[13]  P. Poznanski.  Cost Accounting : Foundations and Evolutions , 2005 .

[14]  Nancy Wilkins-Diehr,et al.  Return on Investment for Three Cyberinfrastructure Facilities: A Local Campus Supercomputer, the NSF-Funded Jetstream Cloud System, and XSEDE (the eXtreme Science and Engineering Discovery Environment) , 2018, 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC).

[15]  Brian Bockelman,et al.  Experience in using commercial clouds in CMS , 2017 .

[16]  Le-Shin Wu,et al.  Trinity RNA-Seq assembler performance optimization , 2012, XSEDE '12.

[17]  Craig A. Stewart,et al.  XSEDE value added, cost avoidance, and return on investment , 2015, XSEDE.

[18]  Lizanne DeStefano,et al.  Cyberinfrastructure Value Assessment Report , 2015 .