Ten-year growth in the scientific production of Brazilian Psychiatry: the impact of the new evaluation policies.

OBJECTIVE Developed by the Ministry of Education, the Qualis evaluation criteria have strongly impacted the scientific production of Post-Graduation Programs. A new set of more stringent criteria has been proposed for Qualis. Our aim was to evaluate the impact of the new Qualis criteria on the scientific production of Post-Graduation Programs in psychiatry over the last 10 years. METHOD We extracted data from annual reports published between 1998 and 2008, and compared performance measured in terms of the old Qualis rating criteria and the new set of criteria. RESULTS There was a 25% increase in the number of Information Science Institute-indexed articles in the second five-year period, which rose from 1,213 to 1,518. While, according to the old Qualis criteria, 84% of the Information Science Institute production would have been classified as highly-rated (IF > 1), only 17% of the papers were classified as highly-rated (A1) according to the new Qualis rating criteria. Most papers (65%) were assigned to intermediate categories (B1 and B2) with an IF < 2.29. DISCUSSION All psychiatric Post-Graduation Programs have increased their production, but by favoring quality over quantity, the new rules have proved to be more useful for discriminating among the scientific production.

[1]  Jerônimo Gerolin,et al.  Mental health and psychiatry research in Brazil: scientific production from 1999 to 2003. , 2006, Revista de saude publica.

[2]  Leopoldo de Meis,et al.  Concentration of science in Brazilian governmental universities , 2004, Scientometrics.

[3]  R. Bressan,et al.  The modest but growing Brazilian presence in psychiatric, psychobiological and mental health research: assessment of the 1998-2002 period. , 2005, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[4]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[5]  Marcelo Francisco Sestini,et al.  MINISTÉRIO DA CIÊNCIA E TECNOLOGIA , 2002 .

[6]  D. Razzouk,et al.  Leading countries in mental health research in Latin America and the Caribbean. , 2007, Revista brasileira de psiquiatria.

[7]  P. Sharan,et al.  Mental health research in Brazil: policies, infrastructure, financing and human resources. , 2006, Revista de saude publica.

[8]  Jacqueline Leta,et al.  Central international visibility of Brazilian psychiatric publications from 1981 to 1995 , 2001, Scientometrics.

[9]  Peng Dong,et al.  The "impact factor" revisited , 2005, Biomedical digital libraries.

[10]  Renata Ribeiro do Valle Gonçalves,et al.  The evaluation of scientific productivity in Brazil: An assessment of the mental health field , 2008, Scientometrics.

[11]  Brasil. Ministério da Ciência e Tecnologia,et al.  Indicadores nacionais de Ciência e Tecnologia – 2002 , 2004 .

[12]  M. Porta,et al.  Commentary: the 'bibliographic impact factor' and the still uncharted sociology of epidemiology. , 2006, International Journal of Epidemiology.

[13]  Richard M. Smith,et al.  Commentary: the power of the unrelenting impact factor--is it a force for good or harm? , 2006, International journal of epidemiology.