Standardizing the evaluation of scientific and academic performance in neurosurgery--critical review of the "h" index and its variants.

Assessing the academic impact and output of scientists and physicians is essential to the academic promotion process and has largely depended on peer review. The inherent subjectivity of peer review, however, has led to an interest to incorporate objective measures into more established methods of academic assessment and promotion. Journal impact factor has been used to add objectivity to the process but this index alone does not capture all aspects of academic impact and achievement. The "h" index and its variants have been designed to compensate for these shortcomings, and have been successfully used in the fields of physics, mathematics, and biology, and more recently in medicine. Leaders in academic neurosurgery should be aware of the advantages offered by each of these indices, as well as of their individual shortcomings, to be able to efficiently use them to refine the peer-review process. This review critically analyzes indices that are currently available to evaluate the academic impact of scientists and physicians. These indices include the total citation count, the total number of papers, the impact factor, as well as the "h" index with eight of its most common variants. The analysis focuses on their use in the field of academic neurosurgery, and discusses means to implement them in current review processes.

[1]  David F Kallmes,et al.  The H-index in academic radiology. , 2010, Academic radiology.

[2]  W. Couldwell,et al.  Use of the h index in neurosurgery. Clinical article. , 2009, Journal of neurosurgery.

[3]  J. Wilberger,et al.  Survey of the h index for all of academic neurosurgery: another power-law phenomenon? , 2010, Journal of neurosurgery.

[4]  J. Hirsch Does the h index have predictive power? , 2007, Proceedings of the National Academy of Sciences.

[5]  A. Lozano,et al.  Academic impact and rankings of American and Canadian neurosurgical departments as assessed using the h index. , 2010, Journal of neurosurgery.

[6]  A. Kulkarni,et al.  Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. , 2009, JAMA.

[7]  S. Bhayani,et al.  Does citation analysis reveal association between h-index and academic rank in urology? , 2009, Urology.

[8]  Rodrigo Costas,et al.  The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level , 2007, J. Informetrics.

[9]  T. Grantcharov,et al.  h-Indices in a university department of anaesthesia: an evaluation of their feasibility, reliability, and validity as an assessment of academic performance. , 2011, British journal of anaesthesia.

[10]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[11]  Jerome K. Vanclay,et al.  On the robustness of the h-index , 2007, J. Assoc. Inf. Sci. Technol..

[12]  A. Warshaw The challenge of faculty retention: a personal reflection. , 2003, Surgery.

[13]  E. Garfield The history and meaning of the journal impact factor. , 2006, JAMA.

[14]  Philip Ball,et al.  Index aims for fair ranking of scientists , 2005, Nature.

[15]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[16]  R. F. Jones,et al.  Faculty appointment and tenure policies in medical schools: a 1997 status report , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[17]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[18]  Susan Balandin,et al.  Impact Factors and the H-Index: What Researchers and Readers Need to Know , 2009, Augmentative and alternative communication.

[19]  Charles R. Thomas,et al.  Bibliometric analysis of radiation oncology departmental scholarly publication productivity at domestic residency training institutions. , 2009, Journal of the American College of Radiology : JACR.

[20]  Leif Engqvist,et al.  The h-index and self-citations. , 2008, Trends in ecology & evolution.

[21]  L. Rikkers Recruiting faculty: a science and an art. , 2003, Surgery.

[22]  Lutz Bornmann,et al.  Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine , 2008, J. Assoc. Inf. Sci. Technol..

[23]  Leo Egghe,et al.  An h-index weighted by citation impact , 2008, Inf. Process. Manag..

[24]  Ronald Rousseau,et al.  New developments related to the Hirsch index , 2006 .

[25]  Philip Ball,et al.  Achievement index climbs the ranks , 2007, Nature.

[26]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[27]  Michelle Cleary,et al.  Psychiatry and the Hirsch h‐index: The Relationship Between Journal Impact Factors and Accrued Citations , 2010, Harvard review of psychiatry.

[28]  Charles R. Thomas,et al.  Estimation of citation-based scholarly activity among radiation oncology faculty at domestic residency-training institutions: 1996-2007. , 2009, International journal of radiation oncology, biology, physics.

[29]  Mark E Mullins Has the time come for bibliometrics and the h-index in academic radiology? , 2010, Academic radiology.

[30]  S. Abdelhak,et al.  Comparing selection criteria of residency directors and physicians' employers , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[31]  M. Jennions,et al.  The h index and career assessment by numbers. , 2006, Trends in ecology & evolution.