IS Journal Quality Assessment Using the Author Affiliation Index

Research productivity is one means by which academic units attain legitimacy within their institutional milieu and make their case for resources. Journal quality assessment is an important component for assessing faculty research productivity. We introduce the Author Affiliation Index (AAI), a simple method for assessing journal quality, to the IS domain. Essentially, the AAI of a journal is the percentage of academic authors publishing in that journal who are affiliated with a base set of high-quality academic institutions. Besides explaining the AAI, we demonstrate its use with a set of well-known IS journals, discuss its rankings vis-a-vis those resulting from other methods, and provide an example of how the basic AAI approach can be modified by changing the base school set that is used to define journal quality. The AAI has a number of advantages. First, it is a simple, low cost and transparent method for assessing any journal given a base school set. Second, it provides a consistent ranking of journals, particularly of those beyond the top consensus journals where less consistency is achieved with other measures. Third, it enables new journals to be rapidly assessed against more established ones without the lags or costs of other measures. The AAI provides another indicator of journal quality that is different from surveys and citation analyses.

[1]  Detmar W. Straub,et al.  Leveling the Playing Field: A Comparative Analysis of Business School Journal Productivity , 2006, Commun. Assoc. Inf. Syst..

[2]  Detmar W. Straub,et al.  Measuring Researcher-Production in Information Systems , 2002, J. Assoc. Inf. Syst..

[3]  Susan Athey,et al.  An Evaluation of Research Productivity in Academic IT , 2000, Commun. Assoc. Inf. Syst..

[4]  Nikolaos A. Mylonopoulos,et al.  On site: global perceptions of IS journals , 2001, CACM.

[5]  Mark A. Fuller,et al.  Research Standards for Promotion and Tenure in Information Systems , 2006, MIS Q..

[6]  Anthony R. Hendrickson,et al.  Research Commentary. Academic Rewards for Teaching, Research, and Service: Data and Discourse , 1999, Inf. Syst. Res..

[7]  Michael F. Gorman,et al.  Evaluating Operations Management-Related Journals via the Author Affiliation Index , 2005, Manuf. Serv. Oper. Manag..

[8]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[9]  Bill C. Hardgrave,et al.  Forums for information systems scholars: III , 2001, Inf. Manag..

[10]  Bill C. Hardgrave,et al.  Forums for management information systems scholars , 1995, CACM.

[11]  Paul Benjamin Lowry,et al.  Global Journal Prestige and Supporting Disciplines: A Scientometric Study of Information Systems Journals , 2004, J. Assoc. Inf. Syst..

[12]  Nikolaos A. Mylonopoulos,et al.  Global perceptions of IS journals , 2001 .

[13]  K. Peffers,et al.  Identifying and Evaluating the Universe of Outlets for Information Systems Research: Ranking the Journals , 2003 .

[14]  Donald S. Siegel,et al.  A Theoretical and Empirical Analysis of Journal Rankings: The Case of Formal Lists , 2000 .

[15]  Mark D. Miller,et al.  Examining differences across journal rankings , 2005, CACM.

[16]  Lee A. Freeman,et al.  The Supply and Demand of Information Systems Doctorates: Past, Present, and Future , 2000, MIS Q..

[17]  Mark A. Fuller,et al.  Issues and Opinions - Publication Opportunities in Premier Business Outlets: How Level Is the Playing Field? , 2006, Inf. Syst. Res..

[18]  Soongoo Hong,et al.  Objective quality ranking of computing journals , 2003, CACM.

[19]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[20]  A. Dennis,et al.  Serving Multiple Constituencies in the Business School: MBA Program vs. Research Performance , 2000 .

[21]  Danial Clapper,et al.  The Rationalization of the Organizational Meeting: Implications of Group Support Systems for Power, Symbolism and Face-Work , 1993, ICIS.

[22]  Stuart J. Barnes,et al.  Assessing the value of IS journals , 2005, CACM.

[23]  Robert N. Stern,et al.  The External Control of Organizations: A Resource Dependence Perspective. , 1979 .

[24]  Jack Shih-Chieh Hsu,et al.  An Evaluation of Publication Productivity in Information Systems: 1999 to 2003 , 2005, Commun. Assoc. Inf. Syst..

[25]  W. Powell,et al.  The iron cage revisited institutional isomorphism and collective rationality in organizational fields , 1983 .

[26]  Scott Hamilton,et al.  The journal communication system for MIS research , 1982, DATB.

[27]  W. Powell,et al.  The New Institutionalism in Organizational Analysis , 1993 .