Research on the evaluation of academic journals based on structural equation modeling

This paper classifies common journal evaluation indicators into three categories, namely three first-level indicators. They are respectively the indicators on journal impact, on timeliness, and on journal characteristics. The data used here is drawn from the medical journals in CSTPCD, a citation database built by the Institute of Scientific and Technical Information of China. The three categories of indicators are correlated with one another, so a structural equation may be established. Then we calculate the value of three first-level indicators and give subjective weights to the indicators. The comprehensive evaluation upon the medical journals yields satisfactory results. By simulating the complex relationship among journal indicators, the structural equation can be used for the estimation of some implicit indicators and the screening of indicators. This approach provides a new perspective for scientific and technological evaluation in general sense. It should be noted that the availability of basic data and the rationality of modeling bear much upon the evaluation results.

[1]  Jyh-Bin YangJ.-B. Yang,et al.  Using structural equation modeling to analyze relationships among key causes of delay in construction , 2008 .

[2]  Wolfgang Glänzel,et al.  A topographical approach to world publication output and performance in the sciences, 1981–1985 , 2005, Scientometrics.

[3]  K. Jöreskog.  A general method for analysis of covariance structures , 1970 .

[4]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[5]  Thed N. van Leeuwen,et al.  New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications , 1995, Scientometrics.

[6]  Thed N. van Leeuwen,et al.  The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence , 2003, Scientometrics.

[7]  Jean Tague-Sutcliffe,et al.  Measuring the impact of information on development: a LISREL-based study of small businesses in Shanghai , 1997 .

[8]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[9]  N. Payakachat,et al.  Factors affecting job and career satisfaction among community pharmacists: a structural equation modeling approach. , 2008, Journal of the American Pharmacists Association : JAPhA.

[10]  A. Sagar,et al.  The human development index: a critical review , 1998 .

[11]  Concepción S. Wilson,et al.  Measuring the citation impact of research journals in clinical neurology: A structural equation modelling analysis , 2004, Scientometrics.

[12]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[13]  Peter Vinkler,et al.  Evaluation of some methods for the relative assessment of scientific publications , 1986, Scientometrics.