Authors' status and the perceived quality of their work: Measuring citation sentiment change in nobel articles

Prior research in status ordering has used numeric indicators to examine the impact of a status change on the perception of a scientist's work. This study measures the perception change directly as reflected in citation sentiment, with the attainment of a Nobel Prize in Chemistry or a Nobel Prize in Physiology or Medicine considered the status change. The article identifies 12,393 citances to 25 Nobel articles in PubMed Central and includes a control article set of 75 articles with 30,851 citances. The results show a moderate increase in citation sentiment toward Nobel articles postaward. Dynamically, for Nobel articles there is a steady sentiment increase, and a Nobel Prize seems to co‐occur with this trend. This trend, however, is not evident in the control article set.

[1]  Awais Athar,et al.  Sentiment Analysis of Citations using Sentence Structure-Based Features , 2011, ACL.

[2]  Goran Glavas,et al.  Investigating Convolutional Networks and Domain-Specific Embeddings for Semantic Classification of Citations , 2017, WOSP@JCDL.

[3]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[4]  Scott D. Graffin,et al.  Reputation and Status: Expanding the Role of Social Evaluations in Management Research , 2016 .

[5]  I. Spiegel-Rosing Science Studies: Bibliometric and Content Analysis , 1977 .

[6]  E. Yan,et al.  Understanding disciplinary vocabularies using a full-text enabled domain-independent term extraction approach , 2017, PloS one.

[7]  J. Ziman,et al.  Public knowledge. An essay concerning the social dimension of science , 1970, Medical History.

[8]  Simone Teufel,et al.  Context-Enhanced Citation Sentiment Detection , 2012, NAACL.

[9]  S Sendhilkumar,et al.  Citation Semantic Based Approaches to Identify Article Quality , 2013 .

[10]  Stephen J. Bensman Distributional differences of the impact factor in the sciences versus the social sciences: An analysis of the probabilistic structure of the 2005 journal citation reports , 2008, J. Assoc. Inf. Sci. Technol..

[11]  Donald Owen Case,et al.  How can we investigate citation behavior? A study of reasons for citing literature in communication , 2000, J. Am. Soc. Inf. Sci..

[12]  Toby E. Stuart,et al.  Interorganizational Endorsements and the Performance of Entrepreneurial Ventures , 1999 .

[13]  Ho Fai Chan,et al.  Awards before and after the Nobel Prize: A Matthew effect and/or a ticket to one’s own funeral? , 2014 .

[14]  José M. Gómez,et al.  Citation Impact Categorization: For Scientific Literature , 2015, 2015 IEEE 18th International Conference on Computational Science and Engineering.

[15]  Katherine W. McCain,et al.  How influential is Brooks’ Law? A longitudinal citation context analysis of Frederick Brooks’ The Mythical Man-Month , 2006, J. Inf. Sci..

[16]  Karsten Weihe,et al.  Improve Sentiment Analysis of Citations with Author Modelling , 2016, WASSA@NAACL-HLT.

[17]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Ben-Ami Lipetz,et al.  Improvement of the selectivity of citation indexes to science literature through inclusion of citation relationship indicators , 1965 .

[19]  Yves Gingras,et al.  Why it has become more difficult to predict Nobel Prize winners: a bibliometric analysis of nominees and winners of the chemistry and physics prizes (1901–2007) , 2009, Scientometrics.

[20]  Muhammad Rafi,et al.  Classification of Research Citations (CRC) , 2015, CLBib@ISSI.

[21]  M. Miller,et al.  Citations, contexts, and humanistic discourse: Toward automatic extraction and classification , 2014, Lit. Linguistic Comput..

[22]  M. Moravcsik,et al.  Some Results on the Function and Quality of Citations , 1975 .

[23]  E. B. Duncan,et al.  Qualified Citation Indexing: Its Relevance to Educational Technology. , 1981 .

[24]  Björn W. Schuller,et al.  SenticNet 4: A Semantic Resource for Sentiment Analysis Based on Conceptual Primitives , 2016, COLING.

[25]  G. Parthasarathy,et al.  Sentiment analyzer: Analysis of journal citations from citation databases , 2014, 2014 5th International Conference - Confluence The Next Generation Information Technology Summit (Confluence).

[26]  Maryam Tayefeh Mahmoudi,et al.  A framework for sentiment analysis on schema-based research content via lexica analysis , 2014, 7'th International Symposium on Telecommunications (IST'2014).

[27]  M. Newman Coauthorship networks and patterns of scientific collaboration , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Tobias Wolbring,et al.  Matched control groups for modeling events in citation data: An illustration of nobel prize effects in citation networks , 2017, J. Assoc. Inf. Sci. Technol..

[29]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.

[30]  Matjaz Perc,et al.  The Matthew effect in empirical data , 2014, Journal of The Royal Society Interface.

[31]  Daryl E. Chubin,et al.  Content Analysis of References: Adjunct or Alternative to Citation Counting? , 1975 .

[32]  Yaoyun Zhang,et al.  Citation Sentiment Analysis in Clinical Trial Papers , 2015, AMIA.

[33]  C. O. Frost The Use of Citations in Literary Research: A Preliminary Classification of Citation Functions , 1979, The Library Quarterly.

[34]  Tapas Samanta,et al.  Number 23 , 2019 .

[35]  Pierre Azoulay,et al.  Matthew: Effect or Fable? , 2012, Manag. Sci..

[36]  Marta Sales-Pardo,et al.  Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal , 2010, J. Assoc. Inf. Sci. Technol..

[37]  M. H. MacRoberts,et al.  The Negational Reference: or the Art of Dissembling , 1984 .

[38]  M E Newman,et al.  Scientific collaboration networks. I. Network construction and fundamental results. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Dragomir R. Radev,et al.  NLP-driven citation analysis for scientometrics , 2016, Natural Language Engineering.

[40]  C. Oppenheim,et al.  A Method of Predicting Nobel Prizewinners in Chemistry , 1978 .

[41]  Frédéric C. Godart,et al.  What is Social Status? Comparisons and Contrasts with Cognate Concepts , 2009 .

[42]  M. Newman Power laws, Pareto distributions and Zipf's law , 2005 .

[43]  R. Merton The Matthew Effect in Science , 1968, Science.

[44]  J. Ioannidis,et al.  Sources of funding for Nobel Prize‐winning work: public or private? , 2010, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[45]  Norman M Kaplan,et al.  The norms of citation behavior: Prolegomena to the footnote , 1965 .

[46]  C. Patterson,et al.  Children's perceptions of self and of relationships with others as a function of sociometric status. , 1990, Child development.

[47]  Awais Athar,et al.  Sentiment analysis of scientific citations , 2014 .

[48]  S. Redner How popular is your paper? An empirical study of the citation distribution , 1998, cond-mat/9804163.

[49]  Bill Harley,et al.  The Myth of Empowerment: Work Organisation, Hierarchy and Employee Autonomy in Contemporary Australian Workplaces , 1999 .

[50]  Tove Faber Frandsen,et al.  The ripple effect: Citation chain reactions of a nobel prize , 2013, J. Assoc. Inf. Sci. Technol..

[51]  B Walter,et al.  [In citation process]. , 2010, Der Radiologe.

[52]  Zheng Chen,et al.  Domain-independent term extraction & term network for scientific publications , 2017 .

[53]  M. Newman,et al.  Scientific collaboration networks. II. Shortest paths, weighted networks, and centrality. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Janusz S. Bień,et al.  Beliefs, Points of View, and Multiple Environments , 1983, Cogn. Sci..

[55]  Henry G. Small,et al.  Interpreting maps of science using citation context sentiments: a preliminary investigation , 2011, Scientometrics.

[56]  Simone Teufel,et al.  Detection of Implicit Citations for Sentiment Detection , 2012, ACL 2012.

[57]  Richard J. Fitzgerald,et al.  Scientific collaboration networks , 2018 .

[58]  D. Cases,et al.  How can we investigate citation behavior?: a study of reasons for citing literature in communication , 2000 .

[59]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[60]  Blaise Cronin,et al.  The citation process: The role and significance of citations in scientific communication , 1984 .

[61]  In-Cheol Kim,et al.  Automated classification of author's sentiments in citation using machine learning techniques: A preliminary study , 2015, 2015 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB).

[62]  Andrea Bergmann,et al.  Citation Indexing Its Theory And Application In Science Technology And Humanities , 2016 .

[63]  Dragomir R. Radev,et al.  Purpose and Polarity of Citation: Towards NLP-based Bibliometrics , 2013, NAACL.

[64]  Staša Milojević,et al.  Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content , 2012, J. Assoc. Inf. Sci. Technol..

[65]  Caroline S. Wagner,et al.  Do Nobel Laureates Create Prize-Winning Networks? An Analysis of Collaborative Research in Physiology or Medicine , 2015, PloS one.

[66]  Ho Fai Chan,et al.  Do Nobel laureates change their patterns of collaboration following prize reception? , 2015, Scientometrics.

[67]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[68]  Per O. Seglen,et al.  The Skewness of Science , 1992, J. Am. Soc. Inf. Sci..