A mathematical approach to assess research diversity: operationalization and applicability in communication sciences, political science, and beyond

With today’s research production and global dissemination, there is growing pressure to assess how academic fields foster diversity. Based on a mathematical problem/solve scheme, the aim of this study is twofold. First, the paper elaborates on how research diversity in scientific fields can be empirically gauged, proposing six working definitions. Second, drawing on these theoretical explanations, we introduce an original methodological protocol for research diversity evaluation. Third, the study puts this mathematical model to an empirical test by comparatively evaluating (1) communication research diversity in 2017, with respect to field’s diversity in 1997, and (2) communication research and political science diversity in 2017. Our results indicate that, contrasted to pattern diversity, communication research in 2017 is not a diverse field. However, throughout the years (1997–2017), there is a statistically significant improvement. Finally, the cross-comparison examination between political and communication sciences reveals the latter to be significantly more diverse.

[1]  Manuel Goyanes,et al.  Editorial boards in communication sciences journals: Plurality or standardization? , 2020, International Communication Gazette.

[2]  Stephen A. Rains,et al.  Titling Practices and Their Implications in Communication Research 1970-2010: Cutesy Cues Carry Citation Consequences , 2019, Communication Research.

[3]  C. So.  SYMPOSIUM ON MASS AND INTERPERSONAL COMMUNICATION , 1988 .

[4]  A. Magurran.  Ecological Diversity and Its Measurement , 1988, Springer Netherlands.

[5]  Everett M. Rogers,et al.  Anatomy of the Two Subdisciplines of Communication Study , 1999 .

[6]  Elizabeth Overman Smith,et al.  Strength in the Technical Communication Journals and Diversity in the Serials Cited , 2000 .

[7]  H. Wasserman.  Power, Meaning and Geopolitics: Ethics as an Entry Point for Global Communication Studies , 2018 .

[8]  Emese Domahidi,et al.  What Communication Scholars Write About: An Analysis of 80 Years of Research in High-Impact Journals , 2017 .

[9]  Loet Leydesdorff,et al.  Knowledge linkage structures in communication studies using citation analysis among communication journals , 2009, Scientometrics.

[10]  James Curran,et al.  De-Westernizing Media Studies , 2000 .

[11]  A. Stirling.  A general framework for analysing diversity in science, technology and society , 2007, Journal of The Royal Society Interface.

[12]  Loet Leydesdorff,et al.  The delineation of an interdisciplinary specialty in terms of a journal set: The case of communication studies , 2009 .

[13]  C. Borgman.  Bibliometrics and Scholarly Communication , 1989 .

[14]  R. Sokal,et al.  Principles of numerical taxonomy , 1965 .

[15]  Wolfgang Glänzel,et al.  Tracing the role of individual journals in a cross-citation network based on different indicators , 2009, Scientometrics.

[16]  C. Borgman,et al.  A Bibliometric Evaluation of Core Journals in Communication Research. , 1983 .

[17]  E. Lauf,et al.  National diversity of major international journals in the field of communication , 2005 .

[18]  M. Zyphur,et al.  Of Journal Editors and Editorial Boards: Who are the Trailblazers in Increasing Editorial Board Gender Equality? , 2016 .

[19]  Ismael Rafols,et al.  Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations , 2010, J. Informetrics.

[20]  Clement Y. K. So.  Citation Patterns of Core Communication Journals: An Assessment of the Developmental Status of Communication. , 1988 .

[21]  S. Waisbord.  Translations| Communication Studies Without Frontiers? Translation and Cosmopolitanism Across Academic Cultures , 2016 .

[22]  Lars Guenther,et al.  Science communication as a field of research : identifying trends, challenges and gaps by analysing research papers , 2017 .

[23]  Félix Ortega,et al.  The Invisibility of Latin American Scholarship in European Media and Communication Studies: Challenges and Opportunities of De-Westernization and Academic Cosmopolitanism , 2019 .

[24]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[25]  W. Leeds-Hurwitz.  Moving (slowly) toward understanding knowledge as a global commons , 2020 .

[26]  Ulla K. Bunz,et al.  Publish or Perish: A Limited Author Analysis of ICA and NCA Journals , 2005 .

[27]  C. R. Rao,et al.  Diversity: its measurement, decomposition, apportionment and analysis , 1982 .

[28]  S. Waisbord,et al.  De‐westernizing Communication Studies: A Reassessment , 2014 .

[29]  C. Borgman,et al.  Citation Networks of Communication Journals, 1977–1985 Cliques and Positions, Citations Made and Citations Received , 1988 .

[30]  Frank Tutzauer,et al.  Central journals and authors in communication using a publication network , 2015, Scientometrics.

[31]  Ismael Rafols,et al.  Knowledge Integration and Diffusion: Measures and Mapping of Diversity and Coherence , 2014, ArXiv.

[32]  M. Jones,et al.  Editorial boards of accounting journals: gender diversity and internationalisation , 2017 .

[33]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[34]  M. Goyanes,et al.  How the Geographic Diversity of Editorial Boards Affects What Is Published in JCR-Ranked Communication Journals , 2020, Journalism & Mass Communication Quarterly.

[35]  Joseph P. Mazer,et al.  Editor's Introduction: Interrogating the Darkness , 2016 .

[36]  Paula E. Stephan,et al.  Inequality in Scientific Performance: Adjustment for Attribution and Journal Impact , 1991 .

[37]  Janos Toth.  „U.S. journals can afford to remain regional, but we can not.” Author distribution-based internationality of Eastern European Communication Journals , 2018 .

[38]  W. Paisley.  Bibliometrics, Scholarly Communication, and Communication Research , 1989 .

[39]  A. Agresti,et al.  Statistical Analysis of Qualitative Variation , 1978 .

[40]  C. R. Rao,et al.  The Utilization of Multiple Measurements in Problems of Biological Classification , 1948 .

[41]  E. Funkhouser.  The Evaluative Use of Citation Analysis for Communication Journals , 1996 .

[42]  B. Everitt.  The Cambridge Dictionary of Statistics , 1998 .

[43]  Ismael Rafols,et al.  Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience , 2009, Scientometrics.

[44]  Loet Leydesdorff,et al.  Interdisciplinarity as Diversity in Citation Patterns among Journals: Rao-Stirling Diversity, Relative Variety, and the Gini coefficient , 2018, J. Informetrics.

[45]  Hee Sun Park,et al.  Where and what do they publish? Editors’ and editorial board members’ affiliated institutions and the citation counts of their endogenous publications in the field of communication , 2019, Scientometrics.

[46]  Wolfgang Glänzel,et al.  Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account , 2016, J. Assoc. Inf. Sci. Technol..

[47]  Wolfgang Glänzel,et al.  Journal cross-citation analysis for validation and improvement of journal-based subject classification in bibliometric research , 2010, Scientometrics.

[48]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[49]  W. Willems.  Provincializing Hegemonic Histories of Media and Communication Studies: Toward a Genealogy of Epistemic Resistance in Africa , 2014 .

[50]  A. Hirschman.  National Power and the Structure of Foreign Trade , 2024 .

[51]  King-Wa Fu,et al.  The Relationship Between Interdisciplinarity and Journal Impact Factor in the Field of Communication During 1997–2016 , 2019, Journal of Communication.

[52]  R. Luthra.  Transforming global communication research with a view to the margins , 2015 .

[53]  Calyampudi R. Rao.  Diversity and dissimilarity coefficients: A unified approach☆ , 1982 .

[54]  Thomas Hugh Feeley,et al.  A Bibliometric Analysis of Communication Journals from 2002 to 2005 , 2008 .

[55]  R. Boschma.  Proximity and Innovation: A Critical Assessment , 2005 .

[56]  Ronald Rousseau,et al.  On the Leydesdorff-Wagner-Bornmann proposal for diversity measurement , 2019, J. Informetrics.

[57]  Marton Demeter,et al.  Changing Center and Stagnant Periphery in Communication and Media Studies: National Diversity of Major International Journals in the Field of Communication from 2013 to 2017 , 2018 .

[58]  M. Cody,et al.  The Ebb and Flow of Communication Research: Seven Decades of Publication Trends and Research Priorities , 2018 .

[59]  Silvia Knobloch-Westerwick,et al.  The Matilda Effect—Role Congruity Effects on Scholarly Communication , 2013, Commun. Res..

[60]  Trevor Diehl,et al.  Citizenship, Social Media, and Big Data , 2017 .