Interpreting "altmetrics": viewing acts on social media through the lens of citation and social theories

More than 30 years after Cronin's seminal paper on "the need for a theory of citing" (Cronin, 1981), the metrics community is once again in need of a new theory, this time one for so-called "altmetrics". Altmetrics, short for alternative (to citation) metrics -- and as such a misnomer -- refers to a new group of metrics based (largely) on social media events relating to scholarly communication. As current definitions of altmetrics are shaped and limited by active platforms, technical possibilities, and business models of aggregators such as Altmetric.com, ImpactStory, PLOS, and Plum Analytics, and as such constantly changing, this work refrains from defining an umbrella term for these very heterogeneous new metrics. Instead a framework is presented that describes acts leading to (online) events on which the metrics are based. These activities occur in the context of social media, such as discussing on Twitter or saving to Mendeley, as well as downloading and citing. The framework groups various types of acts into three categories -- accessing, appraising, and applying -- and provides examples of actions that lead to visibility and traceability online. To improve the understanding of the acts, which result in online events from which metrics are collected, select citation and social theories are used to interpret the phenomena being measured. Citation theories are used because the new metrics based on these events are supposed to replace or complement citations as indicators of impact. Social theories, on the other hand, are discussed because there is an inherent social aspect to the measurements.

[1]  M. Heinemann.  The Matthew Effect , 2016, Thoracic and Cardiovascular Surgeon.

[2]  G. Gilbert.  Referencing as Persuasion , 1977 .

[3]  Vincent Larivière,et al.  Who reads research articles? An altmetrics analysis of Mendeley user categories , 2015, J. Assoc. Inf. Sci. Technol..

[4]  Vincent Larivière,et al.  Tweets vs. Mendeley readers: How do these two social media metrics differ? , 2014, it Inf. Technol..

[5]  L. Bickman,et al.  The SAGE Handbook of Applied Social Research Methods , 2009 .

[6]  Vincent Larivière.  Mendeley as the source of global readership by students and postdocs , 2014 .

[7]  J. Nicolaisen.  Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics , 2010 .

[8]  Sibele Fausto,et al.  Blogging : Indexing and Registering the Change in Science 2 . 0 , 2012 .

[9]  Matthias Hofer,et al.  Perceived bridging and bonding social capital on Twitter: Differentiating between followers and followees , 2013, Comput. Hum. Behav..

[10]  Max Weisbuch,et al.  On Being Liked on the Web and in the "Real World": Consistency in First Impressions across Personal Webpages and Spontaneous Behavior. , 2009, Journal of experimental social psychology.

[11]  M. Newman.  Clustering and preferential attachment in growing networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Judy Luther.  White Paper on Electronic Journal Usage Statistics , 2002 .

[13]  E Garfield,et al.  "Science Citation Index"--A New Dimension in Indexing. , 1964, Science.

[14]  Howard D. White,et al.  Reward, persuasion, and the Sokal Hoax: A study in citation identities , 2004, Scientometrics.

[15]  Dawn R. Gilpin.  Working the Twittersphere: Microblogging as Professional Identity Construction , 2010 .

[16]  Rodrigo Costas,et al.  Users, narcissism and control – tracking the impact of scholarly publications in the 21st century , 2012 .

[17]  R. Putnam.  Bowling Alone: America's Declining Social Capital , 1995, The City Reader.

[18]  Mike Thelwall,et al.  Assessing non-standard article impact using F1000 labels , 2013, Scientometrics.

[19]  M. Newman.  Power laws, Pareto distributions and Zipf's law , 2005 .

[20]  Loet Leydesdorff,et al.  Theories of Citation , 1998 .

[21]  J. Coleman,et al.  Social Capital in the Creation of Human Capital , 1988, American Journal of Sociology.

[22]  R. Merton.  The Matthew Effect in Science , 1968, Science.

[23]  Tobias Siebenlist,et al.  Applying social bookmarking data to evaluate journal usage , 2011, J. Informetrics.

[24]  Nikos Bozionelos,et al.  Careers Patterns in Greek Academia: Social Capital and Intelligent Careers, but for Whom? , 2014 .

[25]  Loet Leydesdorff,et al.  Theories of citation? , 1998, Scientometrics.

[26]  Rodrigo Costas,et al.  How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications , 2014, Scientometrics.

[27]  Michael L. Nelson,et al.  Determining the publication impact of a digital library , 2000 .

[28]  Samuel D. Gosling,et al.  Personality Impressions Based on Facebook Profiles , 2007, ICWSM.

[29]  Jeppe Nicolaisen,et al.  Citation analysis , 2007, Annu. Rev. Inf. Sci. Technol..

[30]  Mike Thelwall,et al.  Tweeting Links to Academic Articles , 2013 .

[31]  S. Haustein,et al.  Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns , 2015, PloS one.

[32]  Jean King.  A review of bibliometric and other science indicators and their role in research evaluation , 1987, J. Inf. Sci..

[33]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[34]  Henry G. Small,et al.  On the shoulders of Robert Merton: Towards a normative theory of citation , 2004, Scientometrics.

[35]  Blaise Cronin,et al.  Invoked on the Web , 1998, J. Am. Soc. Inf. Sci..

[36]  Mike Thelwall,et al.  Disciplinary differences in Twitter scholarly communication , 2014, Scientometrics.

[37]  J. Richardson.  Handbook of Theory and Research for the Sociology of Education , 1986 .

[38]  Norman M Kaplan,et al.  The norms of citation behavior: Prolegomena to the footnote , 1965 .

[39]  Vincent Larivière,et al.  Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter , 2014, J. Assoc. Inf. Sci. Technol..

[40]  J. Knote.  Bowling alone: The collapse and revival of American community , 2004 .

[41]  Andrew B. Whinston,et al.  Information or attention? An empirical study of user contribution on Twitter , 2011, Information Systems and e-Business Management.

[42]  P. Bourdieu.  The specificity of the scientific field and the social conditions of the progress of reason , 1975 .

[43]  J. Coleman.  Foundations of Social Theory , 1990 .

[44]  Marthyn G.M. Borghuis.  User feedback from electronic subscriptions: The possibilities of logfile analysis , 1997 .

[45]  Henry Small,et al.  Cited Documents as Concept Symbols , 1978 .

[46]  Emanuela Riviera.  Testing the strength of the normative approach in citation theory through relational bibliometrics: The case of italian sociology , 2015, J. Assoc. Inf. Sci. Technol..

[47]  Ehsan Mohammadi,et al.  Identifying the invisible impact of scholarly publications : a multi-disciplinary analysis using 'altmetrics' , 2015 .

[48]  三嶋 博之.  The theory of affordances , 2008 .

[49]  R. Merton.  Social Theory and Social Structure , 1958 .

[50]  Michael J. Moravcsik,et al.  Variation of the nature of citation measures with journals and scientific specialties , 1978, J. Am. Soc. Inf. Sci..

[51]  Lutz Bornmann,et al.  Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime , 2014, J. Informetrics.

[52]  Mike Thelwall,et al.  How is research blogged? A content analysis approach , 2015, J. Assoc. Inf. Sci. Technol..

[53]  Peter Ingwersen,et al.  Informetric analyses on the world wide web: methodological approaches to 'webometrics' , 1997, J. Documentation.

[54]  Gunther Eysenbach,et al.  Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact , 2011, Journal of medical Internet research.

[55]  Thed N. van Leeuwen,et al.  Referencing patterns of individual researchers: Do top scientists rely on more extensive information sources? , 2012, J. Assoc. Inf. Sci. Technol..

[56]  Rodrigo Costas,et al.  What is the impact of the publications read by the different Mendeley users? Could they help to identify alternative types of impact? PLoS ALM Workshop, San Francisco , 2013 .

[57]  Anne F. Matthew.  Managing Distraction and Attention in Diverse Cohorts: 21st Century Challenges to Law Student Engagement , 2012 .

[58]  Blaise Cronin,et al.  Bibliometrics and beyond: some thoughts on web-based citation analysis , 2001, J. Inf. Sci..

[59]  B. Cronin.  A hundred million acts of whimsy , 2005 .

[60]  Cassidy R. Sugimoto,et al.  Bias in peer review , 2013, J. Assoc. Inf. Sci. Technol..

[61]  J. Maxwell.  Designing a qualitative study. , 1998 .

[62]  Georg Franck,et al.  The scientific economy of attention: A novel approach to the collective rationality of science , 2002, Scientometrics.

[63]  N. D. Bellis.  Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics , 2009 .

[64]  Rousseau Ronald,et al.  A multi-metric approach for research evaluation , 2013 .

[65]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[66]  R. Merton.  The Matthew Effect in Science, II: Cumulative Advantage and the Symbolism of Intellectual Property , 1988, Isis.

[67]  J. Ziman.  Real Science: What It Is and What It Means , 2000 .

[68]  Blaise Cronin,et al.  The Hand of Science: Academic Writing and Its Rewards , 2005 .

[69]  Norman Kaplan,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1974 .

[70]  Derek de Solla Price,et al.  A general theory of bibliometric and other cumulative advantage processes , 1976, J. Am. Soc. Inf. Sci..

[71]  P. Adler,et al.  Social Capital: Prospects for a New Concept , 2002 .

[72]  Martin Fenner,et al.  Altmetrics in Evolution: Defining and Redefining the Ontology of Article-Level Metrics , 2013 .

[73]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[74]  Lutz Bornmann,et al.  Is there currently a scientific revolution in Scientometrics? , 2013, J. Assoc. Inf. Sci. Technol..

[75]  Mike Thelwall,et al.  Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics , 2014, J. Assoc. Inf. Sci. Technol..

[76]  Vincent Larivière,et al.  The impact factor's Matthew Effect: A natural experiment in bibliometrics , 2009, J. Assoc. Inf. Sci. Technol..

[77]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[78]  Ludo Waltman,et al.  F1000 Recommendations as a Potential New Data Source for Research Evaluation: A Comparison With Citations , 2014, J. Assoc. Inf. Sci. Technol..

[79]  Josef Falkinger,et al.  Attention Economies , 2003, J. Econ. Theory.

[80]  Mike Thelwall,et al.  Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows , 2014, J. Assoc. Inf. Sci. Technol..

[81]  D J PRICE,et al.  NETWORKS OF SCIENTIFIC PAPERS. , 1965, Science.

[82]  Paul Otlet,et al.  Paul Otlet: le visionnaire de la bibliologie texte extrait du Traité de documentation - Le livre sur le livre , 1988 .

[83]  M. BONITZ,et al.  Characteristics and impact of the matthew effect for countries , 1997, Scientometrics.

[84]  Rodrigo Costas,et al.  The thematic orientation of publications mentioned on social media: Large-scale disciplinary comparison of social media metrics with citations , 2015, Aslib J. Inf. Manag..

[85]  P. Bourdieu.  Forms of Capital , 2002 .

[86]  Cliff Lampe,et al.  Bowling online: social networking and social capital within the organization , 2009, C&T.

[87]  Mark S. Granovetter.  The Strength of Weak Ties , 1973, American Journal of Sociology.

[88]  B. Huberman.  Social Computing and the Attention Economy , 2012, Journal of Statistical Physics.

[89]  A. Portes.  Social Capital: Its Origins and Applications in Modern Sociology , 1998 .

[90]  Blaise Cronin,et al.  The Need for a Theory of citing , 1981, J. Documentation.

[91]  Euan Adie,et al.  Taking the alternative mainstream , 2014 .

[92]  Raf Guns,et al.  The three dimensions of informetrics: a conceptual view , 2013, J. Documentation.

[93]  Eileen A. Hogan.  The Attention Economy: Understanding the New Currency of Business , 2001 .

[94]  Vincent Larivière,et al.  Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature , 2013, J. Assoc. Inf. Sci. Technol..

[95]  Kerk F. Kee,et al.  Lessons from Facebook: The Effect of Social Network Sites on College Students' Social Capital 1 , 2008 .

[96]  E. Goffman.  Frame analysis: An essay on the organization of experience , 1974 .

[97]  M. Thelwall,et al.  Research Blogs and the Discussion of Scholarly Information , 2012, PloS one.

[98]  E. Goffman.  The Presentation of Self in Everyday Life , 1959 .

[99]  P. Wouters.  The citation culture , 1999 .

[100]  B. Cronin,et al.  The praxis of acknowledgement: from bibliometrics to influmetrics , 1995 .

[101]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .