How to use bibliometric methods in evaluation of scientific research? An example from Finnish schizophrenia research

We present bibliometric methods that can be utilized in evaluation processes of scientific work. In this paper, we present some practical clues using Finnish schizophrenia research as an example and comparing the research output of different institutions. Bibliometric data and indicators including publication counts, impact factors and received citations were used as tools for evaluating research performance in Finnish schizophrenia research. The articles and citations were searched from the Web of Science database. We used schizophrenia as a keyword and defined address Finland, and limited years to 1996–2005. When we analysed Finnish schizophrenia research, altogether 265 articles met our criteria. There were differences in impact factors and received citations between institutions. The number of annually published Finnish schizophrenia articles has tripled since the mid-1990s. International co-operation was common (43%). Bibliometric methods revealed differences between institutions, indicating that the methods can be applied in research evaluation. The coverage of databases as well as the precision of their search engines can be seen as limitations. Bibliometric methods offer a practical and impartial way to estimate publication profiles of researchers and research groups. According to our experience, these methods can be used as an evaluation instrument in research together with other methods, such as expert opinions and panels.

[1]  Pentti Nieminen,et al.  The effect of statistical methods and study reporting characteristics on the number of citations: A study of four general psychiatric journals , 2003, Scientometrics.

[2]  G. Lewison,et al.  Bibliometric methods for the evaluation of arthritis research. , 1999, Rheumatology.

[3]  Peter Ingwersen,et al.  Visibility and impact of research in Psychiatry for North European countries in EU, US and world contexts , 2002, Scientometrics.

[4]  David Adam,et al.  Citation analysis: The counting house , 2002, Nature.

[5]  Koenraad Debackere,et al.  Using a bibliometric approach to support research policy making: The case of the Flemish BOF-key , 2004, Scientometrics.

[6]  Klaus Kuhn,et al.  [The journal impact factor as a parameter for the evaluation of researchers and research]. , 2004, Medizinische Klinik.

[7]  Eduard Vieta,et al.  Bipolar disorder as an emerging pathology in the scientific literature: a bibliometric approach. , 2006, Journal of affective disorders.

[8]  John J. Hubert General Bibliometric Models. , 1981 .

[9]  Karl-Franz Kaltenborn,et al.  Der Impact-Faktor als Parameter zur Evaluation von Forscherinnen/Forschern und Forschung , 2003, Medizinische Klinik.

[10]  E Garfield,et al.  Which medical journals have the greatest impact? , 1986, Annals of internal medicine.

[11]  J. Suvisaari,et al.  Decline in the incidence of schizophrenia in Finnish cohorts born from 1954 to 1965. , 1999, Archives of general psychiatry.

[12]  Gabriel Rubio,et al.  Bibliometric analysis of biomedical publications on SSRI during 1980–2000 , 2003, Depression and anxiety.

[13]  Jacqueline Leta,et al.  A comparison between domestic and international publications in Brazilian psychiatry , 2003, Scientometrics.

[14]  J D Terwilliger,et al.  Linkage analysis of putative schizophrenia gene candidate regions on chromosomes 3p, 5q, 6p, 8p, 20p and 22q in a population-based sampled Finnish family set , 1998, Molecular Psychiatry.

[15]  Jacqueline Leta,et al.  Central international visibility of Brazilian psychiatric publications from 1981 to 1995 , 2001, Scientometrics.

[16]  Leena Peltonen,et al.  Genome scan meta-analysis of schizophrenia and bipolar disorder, part II: Schizophrenia. , 2003, American journal of human genetics.

[17]  M. Isohanni,et al.  Schizophrenia as a long-term outcome of pregnancy, delivery, and perinatal complications: a 28-year follow-up of the 1966 north Finland general population birth cohort. , 1998, The American journal of psychiatry.

[18]  M. Amin,et al.  Impact factors: use and abuse. , 2003, Medicina.