Rejoinder to "Reconsidering Counting Articles in Ranked Venues (CARV) as the Appropriate Evaluation Criteria for the Advancement of Democratic Discourse in the IS Field"

In their article, Cuellar, Truex, and Takeda (2019) criticize the “process for evaluating scholarly output, “counting articles in ranked venues’ (CARV)” (p. 188). In their view, CARV limits the open exchange of ideas and, thereby, democratic discourse, which leads to unwanted performative effects and, ultimately, inhibits the growth of the information systems (IS) field. They propose the scholarly capital model (SCM) as a preferable mechanism that evaluators should employ to assess scholarly capital instead of scholarly output. In this rejoinder, we argue that CARV does not claim to measure output quality; it neither limits quality in the IS field nor the IS field’s growth, and mingling the effects of CARV with debates on quality or growth could be misleading. Replacing CARV would not change the game, only its rules. We posit that we all entered academia voluntarily knowing its rules and argue that colleagues facing P&T committees should recognize and focus on the specific (CARV-based or not) criteria of their institutions’ committees. While we expect that a new method will replace CARV in the not so distant future, we are convinced that, until then, a CARV-based environment offers ample opportunity to advance quality and growth of the IS field.

[1]  Izak Benbasat,et al.  The Identity Crisis Within the IS Discipline: Defining and Communicating the Discipline's Core Properties , 2003, MIS Q..

[2]  Claudia Löbbecke,et al.  Engaging scientometrics in information systems , 2017, J. Inf. Technol..

[3]  J. Mouritsen Problematising intellectual capital research: ostensive versus performative IC , 2006 .

[4]  Richard T. Vidgen,et al.  Ideational Influence, Connectedness, and Venue Representation: Making an Assessment of Scholarly Capital , 2016, J. Assoc. Inf. Syst..

[5]  F. C. P. Motta The theory of communicative action , 1991 .

[6]  Claudia Löbbecke,et al.  Research Importance in the Information Systems Field: A Citations Analysis , 2007, ICIS.

[7]  Claudia Löbbecke,et al.  The Contribution of Top IS Publications to Subsequent Research: A Citation Analysis , 2012, Commun. Assoc. Inf. Syst..

[8]  John Mingers,et al.  Taylorizing business school research: On the ‘one best way’ performative effects of journal ranking lists , 2013 .

[9]  N. Adler,et al.  When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings , 2009 .

[10]  Duane P. Truex,et al.  Reconsidering Counting Articles in Ranked Venues (CARV) as the Appropriate Evaluation Criteria for the Advancement of Democratic Discourse in the IS Field , 2019, Commun. Assoc. Inf. Syst..

[11]  Robert D. Galliers,et al.  Change as Crisis or Growth? Toward a Trans-disciplinary View of Information Systems as a Field of Study: A Response to Benbasat and Zmud's Call for Returning to the IT Artifact , 2003, J. Assoc. Inf. Syst..