How Do Scholars Evaluate and Promote Research Outputs? An NTU Case Study

Academic scholars have begun to use diverse social media tools to disseminate and evaluate research outputs. Altmetrics which are indices based on social media, have emerged in recent years and have received attention from scholars from a variety of research areas. This case study aims to investigate how researchers at Nanyang Technological University (NTU) promote their research outputs and how they conduct research evaluation. We conducted semi-structured interviews with eighteen NTU researchers. Results from the study show that NTU researchers still prefer traditional metrics such as citation count, journal impact factor (JIF) and h-index for their research evaluation. They find these metrics are essential determinants to identify the quality of a research paper. In terms of altmetrics, most NTU researchers interviewed are aware of them, but have not yet used them in research evaluation. Furthermore, we found that the main methods used to promote research outputs are attending academic conferences and publishing papers in journals. However, NTU researchers also embark on using social networking sites to disseminate new findings. The results of this study contribute to the previous literature to help understand how social media and altmetrics are influencing the traditional methods of promoting and evaluating research outputs in academia.

[1]  Ruth Harris,et al.  Using Twitter™ to drive research impact: A discussion of strategies, opportunities and challenges. , 2016, International journal of nursing studies.

[2]  Tobias Siebenlist,et al.  Applying social bookmarking data to evaluate journal usage , 2011, J. Informetrics.

[3]  Katrin Weller Social Media and Altmetrics: An Overview of Current Alternative Approaches to Measuring Scholarly Impact , 2015 .

[4]  Robert G. Capra,et al.  Factors mediating disclosure in social network sites , 2011, Comput. Hum. Behav..

[5]  Anatoliy A. Gruzd,et al.  Tenure and promotion in the age of online social media , 2011, ASIST.

[6]  Ian Rowlands,et al.  Social media use in the research workflow , 2011, Inf. Serv. Use.

[7]  Mike Thelwall,et al.  Evaluating altmetrics , 2013, Scientometrics.

[8]  C. Strasser,et al.  Researcher Perspectives on Publication and Peer Review of Data , 2014, PloS one.

[9]  Isabel Gómez,et al.  Advantages and limitations in the use of impact factor measures for the assessment of research performance , 2002, Scientometrics.

[10]  Daipayan Guha,et al.  Social Media Metrics and Bibliometric Profiles of Neurosurgical Departments and Journals: Is There a Relationship? , 2016, World neurosurgery.

[11]  Vincent Larivière,et al.  Scholarly use of social media and altmetrics: A review of the literature , 2016, J. Assoc. Inf. Sci. Technol..

[12]  Executive Summary,et al.  Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines - Executive Summary , 2010 .

[13]  Anatoliy A. Gruzd,et al.  Connected scholars: Examining the role of social media in research practices of faculty using the UTAUT model , 2012, Comput. Hum. Behav..

[14]  L. Bonetta Scientists Enter the Blogosphere , 2007, Cell.

[15]  Steven Ovadia,et al.  When Social Media Meets Scholarly Publishing , 2013 .

[16]  Yin Leng Theng,et al.  Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media , 2016, Scientometrics.