Introducing the ‘alt-index’ for measuring the social visibility of scientific research

We propose a new metric called ‘alt-index’, which is analagous to the h -index, but uses altmetrics data to measure both the volume and social media activity of scientific literature. The dataset includes over 1.1 million papers and their associated altmetrics score. A correlation analysis of the h -index and alt-index is conducted at three different levels: field level, source (journal) level, and author level. Our results show a strong positive correlation between the two indexes across all levels. We conclude that the alt-index can be adopted to measure the social activity of publications in situations where there is agreement amongst various social media channels.

[1]  Roberta Kwok,et al.  Research impact: Altmetrics make their mark , 2013, Nature.

[2]  Lutz Bornmann,et al.  t factor: A metric for measuring impact on Twitter , 2015, ArXiv.

[3]  S. Haustein,et al.  Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns , 2015, PloS one.

[4]  Peter Haddawy,et al.  Uncovering fine-grained research excellence: The global research benchmarking system , 2017, J. Informetrics.

[5]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.

[6]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[7]  Tobias Siebenlist,et al.  Cross-metric compatability and inconsistencies of altmetrics , 2018, Scientometrics.

[8]  M. Kosmulski A new Hirsch-type index saves time and works equally well as the original h-index , 2009 .

[9]  Bradley M. Hemminger,et al.  Scientometrics 2.0: New metrics of scholarly impact on the social Web , 2010, First Monday.

[10]  Stefanie Haustein,et al.  Grand challenges in altmetrics: heterogeneity, data quality and dependencies , 2016, Scientometrics.

[11]  Stefanie Haustein,et al.  Multidimensional Journal Evaluation - Analyzing Scientific Periodicals beyond the Impact Factor , 2012 .

[12]  Mike Thelwall,et al.  Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations? , 2019, J. Informetrics.

[13]  Peter J. Rolla User Tags versus Subject Headings: Can User-Supplied Data Improve Subject Access to Library Collections? , 2009 .

[14]  Bradley M. Hemminger,et al.  Altmetrics in the wild: Using social media to explore scholarly impact , 2012, ArXiv.

[15]  Christoph Bartneck,et al.  Detecting h-index manipulation through self-citation analysis , 2010, Scientometrics.

[16]  Fereshteh Didegah,et al.  Measuring social media activity of scientific literature: an exhaustive comparison of scopus and novel altmetrics big data , 2017, Scientometrics.

[17]  Cassidy R. Sugimoto,et al.  Do Altmetrics Work? Twitter and Ten Other Social Web Services , 2013, PloS one.

[18]  Norma Graciela Cuellar,et al.  Impact Factor , 2016, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[19]  Ronald Rousseau,et al.  New developments related to the Hirsch index , 2006 .

[20]  Xi Zhang,et al.  An effectiveness analysis of altmetrics indices for different levels of artificial intelligence publications , 2019, Scientometrics.

[21]  Gunther Eysenbach,et al.  Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact , 2011, Journal of medical Internet research.

[22]  Rodrigo Costas,et al.  General discussion of data quality challenges in social media metrics: Extensive comparison of four major altmetric data aggregators , 2018, PloS one.

[23]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[24]  Wolfgang Glänzel,et al.  A Hirsch-type index for journals , 2006, Scientometrics.

[25]  Erika Dimmler Informationswissenschaftliche Zeitschriften in szientometrischer Analyse : Grazia Colonia , 2002 .

[26]  PetroviciDan,et al.  Using the h-index to measure the quality of journals in the field of business and management , 2012 .

[27]  M. Freitas,et al.  The Impact Factor , 2013 .

[28]  Stacy Konkiel,et al.  Altmetrics: diversifying the understanding of influential scholarship , 2016, Palgrave Communications.

[29]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[30]  Isabella Peters,et al.  Using social bookmarks and tags as alternative indicators of journal content description , 2012, First Monday.

[31]  Leo Egghe,et al.  An h-index weighted by citation impact , 2008, Inf. Process. Manag..

[32]  Vincent Larivière,et al.  Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter , 2014, J. Assoc. Inf. Sci. Technol..

[33]  Feng Xia,et al.  Bibliographic Analysis of Nature Based on Twitter and Facebook Altmetrics Data , 2016, PloS one.

[34]  Xi Chen,et al.  Combination of EigenfactorTM and h-index to evaluate scientific journals , 2009, Scientometrics.

[35]  Tobias Siebenlist,et al.  Applying social bookmarking data to evaluate journal usage , 2011, J. Informetrics.

[36]  Joost C. F. de Winter,et al.  The relationship between tweets, citations, and article views for PLOS ONE articles , 2014, Scientometrics.

[37]  Vincent Larivière,et al.  Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature , 2013, J. Assoc. Inf. Sci. Technol..

[38]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[39]  John Mingers,et al.  Using the h-index to measure the quality of journals in the field of business and management , 2012, Inf. Process. Manag..

[40]  Andreas Meier,et al.  Altmetrics: State of the Art and a Look into the Future , 2018, Scientometrics.

[41]  Jorge E. Hirsch,et al.  hα: An index to quantify an individual’s scientific leadership , 2018, Scientometrics.

[42]  L. Egghe An improvement of the h-index: the g-index , 2006 .

[43]  Quentin L. Burrell,et al.  On the h-index, the size of the Hirsch core and Jin's A-index , 2007, J. Informetrics.

[44]  Andrea Giovanni Nuzzolese,et al.  Do altmetrics work for assessing research quality? , 2018, Scientometrics.

[45]  Daniel Torres-Salinas,et al.  Altmetrics, alternative indicators for Web of Science Communication studies journals , 2019, Scientometrics.

[46]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[47]  Rabeeh Ayaz Abbasi,et al.  Mining network-level properties of Twitter altmetrics data , 2019, Scientometrics.