A pilot study on normalized weighted approach to citation study: A case of logistics and transportation journals

The results from citation studies of journals have often been used as a benchmark in evaluating a faculty member's productivity for tenure, salary adjustment, teaching load reduction and other areas. It is also often used in ranking academic programs of particular disciplines in universities. This paper attempts to rank the leading journals in the logistics and transportation discipline using three different approaches: total weighted score, total weighted score on citations provided by journals other than the journal in question, and standardized weighted score. A different weight is assigned to each citation depending on whether the article in question is written by single or multiple authors, there are multiple citations of the same study, or the citation is from author/s’ own work. The ranks of journals differ depending on the citation study methods used. A sample of 19 journals in the logistics and transportation field for the year, 1999 was used as a sample space. The results of the study using the most objective and rigorous criterion, standardized weighted score, indicate that the top five journals in the logistics and transportation field are in order of their ranks, the Journal of Business Logistics, International Journal of Physical Distribution & Logistics Management, Transportation Journal, Production and Inventory Management Journal, and Journal of Supply Chain Management. Although this study reveals that the top three ranked journals remain stable regardless of the method used, there is strong evidence that the rankings of journals fluctuate widely based on volume and numbers of pages of the journals in question as depicted by the wide movements in Transportation Quarterly, Transportation Science and International Journal of Logistics. Standardized approach is a unique method to neutralize such bias in the citation study. Study limitations including study period of one year are discussed.

[1]  Mary J. Culnan,et al.  The intellectual development of management information systems, 1972-1982: a co-citation analysis , 1986 .

[2]  G. Hult,et al.  Faculty Perceptions of Marketing Journals , 1997 .

[3]  E. Burton Swanson,et al.  Research in Management Information Systems, 1980-1984: Points of Work and Reference , 1986, MIS Q..

[4]  Mike Cudd,et al.  BIAS IN JOURNAL RATINGS , 1988 .

[5]  R. Brockhaus,et al.  Entrepreneural Research: Are We Playing the Correct Game? , 1987 .

[6]  Jennifer A. Chatman,et al.  Intellectual Structure of Research in Organizational Behavior, 1972-1984: A Cocitation Analysis. , 1990 .

[7]  Janek Ratnatunga,et al.  The role of marketing , 1995 .

[8]  Joseph A. Cote,et al.  Assessing the Influence of Journal of Consumer Research: A Citation Analysis , 1991 .

[9]  Mary J. Culnan,et al.  Mapping the Intellectual Structure of MIS, 1980-1985: A Co-Citation Analysis , 1987, MIS Q..

[10]  T. E. Nisonger A methodological issue concerning the use of Social sciences citation index journal citation reports impact factor data for journal ranking , 1994 .

[11]  D B Vellenga,et al.  AN ANALYSIS OF AUTHOR AFFILIATION FOR PUBLICATIONS IN TRANSPORTATION AND LOGISTICS ACADEMIC JOURNALS, 1967-1979 , 1981 .

[12]  P. Gross,et al.  COLLEGE LIBRARIES AND CHEMICAL EDUCATION. , 1927, Science.

[13]  Frederick Oster,et al.  RESEARCH NOTES AND COMMUNICATIONS THE DEVELOPMENT OF STRATEGIC MANAGEMENT: JOURNAL QUALITY AND ARTICLE IMPACT , 1990 .

[14]  P. Murphy Journal Quality Assessment for Performance Based Funding , 1998 .

[15]  J. Hanna,et al.  PERIODICAL USEFULNESS: THE U.S. LOGISTICS EDUCATOR PERSPECTIVE , 2003 .

[16]  E. Garfield,et al.  Citation and Distinction , 1973, Nature.

[17]  K. Heischmidt,et al.  Rating of Marketing Publications: Impact of Accreditation and Publication History , 1993 .

[18]  J. R. Cole,et al.  Scientific output and recognition: a study in the operation of the reward system in science. , 1967, American sociological review.

[19]  T. E. Nisonger A ranking of political science journals based on citation data , 1993 .

[20]  S. M. Leong A Citation Analysis of the Journal of Consumer Research , 1989 .

[21]  P. R. Murphy,et al.  Educational strategies for succeeding in logistics: a comparative analysis , 1994 .

[22]  Julie A. C. Virgo,et al.  A Statistical Procedure for Evaluating the Importance of Scientific Papers , 1977, The Library Quarterly.

[23]  L. Brown,et al.  Using Citation Analysis to Assess the Impact of Journals and Articles on Contemporary Accounting Research (CAR) , 1985 .

[24]  Kenneth E. Clark Indices of eminence. , 1957 .

[25]  Larry M. Robinson,et al.  Measuring the impact of marketing scholars and institutions: an analysis of citation frequency , 1981 .