Evaluating the scientific impact of research infrastructures: The role of current research information systems

Research infrastructures (RIs) offer researchers a multitude of research opportunities and services and play a key role in the performance, innovative strength, and international competitiveness of science. As an important part of the generation and use of new knowledge and technologies, they are essential for research policies. Because of their strategic importance and their need for significant funding, there is a growing demand for the assessment of their scientific output and impact. Current research information systems (CRIS) have contributed for many years now to the evaluation of universities and research organizations. Based on studies on the application of CRIS to infrastructures and on a recent French report on the scientometric assessment of RI, this paper analyzes the potential of CRIS and their data models and standards (in particular the international CERIF format and the German RDC model) for the monitoring and evaluation of RIs. The interaction between functional specificities of RI and standards for their assessment is outlined, with reference to their own potential to stimulate and share innovation in the networks located inside and outside RIs. This societal challenge, more than an academic issue, is on the way to further harmonization and consolidation of shared and common RI metrics.

[1]  Dan Brickley,et al.  Google Dataset Search: Building a search engine for datasets in an open Web ecosystem , 2019, WWW.

[2]  Miguel-Ángel Sicilia,et al.  Entities and Identities in Research Information Systems , 2012, CRIS.

[3]  Nikos Houssos,et al.  The CERIF-based EuroRIs-Net+ Observatory , 2013 .

[4]  Philipp Mayr,et al.  Editorial: Mining Scientific Papers: NLP-enhanced Bibliometrics , 2019, Front. Res. Metr. Anal..

[6]  Vasilis Bonis European wide infrastructures and services on research information management , 2016 .

[7]  Keith G. Jeffery,et al.  Mapping Solid Earth Data and Research Infrastructures to CERIF , 2016, CRIS.

[8]  Olga Berestneva,et al.  Communications in Computer and Information Science , 2015 .

[9]  Daniela Luzi,et al.  Integrating CERIF Entities in a Multidisciplinary e-infrastructure for Environmental Research Data , 2014, CRIS.

[10]  Renaud Fabre A "Searchable" Space with Routes for Querying Scientific Information , 2019, BIR@ECIR.

[11]  S. Forte,et al.  Forecasting the socio-economic impact of the Large Hadron Collider: A cost–benefit analysis to 2025 and beyond , 2016, 1603.00886.

[12]  Ralph Ewerth,et al.  Requirements Analysis for an Open Research Knowledge Graph , 2020, TPDL.

[13]  Gunter Saake,et al.  Quality of Research Information in RIS Databases: A Multidimensional Approach , 2019, BIS.

[14]  Roxanne Missingham,et al.  Research information management: defining RIM and the library’s role , 2017 .

[15]  Reference framework for assessing the scientific and socio-economic impact of research infrastructures , 2019, OECD Science, Technology and Industry Policy Papers.

[16]  Nico Herbig,et al.  Mapping and semantic interoperability of the German RCD data model with the Europe-wide accepted CERIF , 2020, Inf. Serv. Use.

[17]  Martin Doerr,et al.  Towards contextual awareness and interoperability in an innovative VRE: mapping individual metadata schemata to CERIF , 2015 .

[18]  Pablo de Castro The role of Current Research Information Systems (CRIS) in supporting Open Science implementation : the case of Strathclyde , 2018 .

[19]  Jan Dvořák Research Information: The euroCRIS Context , 2013 .

[20]  Max BLOUIN,et al.  CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE , 2009 .

[21]  Gunter Saake,et al.  Implementation and user acceptance of research information systems , 2019, Data Technol. Appl..

[22]  Peter Richardson,et al.  Weathering changes and challenges to society publishing , 2020, Learn. Publ..

[23]  Thorsten Höllrigl,et al.  Advances in Sharing and Managing Knowledge about European Research Infrastructures , 2012, CRIS.

[24]  Julija Baginskaite European Science Foundation: new projects and developments , 2017 .

[25]  George Tsatsaronis Metrics and Trends in Assessing the Scientific Impact , 2020, BIR@ECIR.

[26]  Gunter Saake,et al.  Solving problems of research information heterogeneity during integration - using the European CERIF and German RCD standards as examples , 2019, Inf. Serv. Use.

[27]  Ulrich Schwardmann,et al.  Persistent Identification Of Instruments , 2020, Data Sci. J..

[28]  Guillaume Cabanac,et al.  Scholarly literature mining with information retrieval and natural language processing: Preface , 2020, Scientometrics.

[29]  Shirley Y. Crompton,et al.  Collaborative information management in scientific research processes , 2012, 2012 IEEE 8th International Conference on E-Science.

[30]  Joachim Schöpfel,et al.  Influence of Information Quality via Implemented German RCD Standard in Research Information Systems , 2020, Data.

[31]  Massimo Aria,et al.  bibliometrix: An R-tool for comprehensive science mapping analysis , 2017, J. Informetrics.

[32]  Paolo Manghi,et al.  Open Science Graphs Must Interoperate! , 2020, ADBIS/TPDL/EDA Workshops.

[33]  Valérie Brasse MERIL: An e-infrastructure to connect Research Infrastructures , 2012 .

[34]  Ivanović Dragan,et al.  A mapping tool for semantic interoperability of research information systems , 2018 .