Which cities produce excellent papers worldwide more than can be expected? A new mapping approach--using Google Maps--based on statistical significance testing

The methods presented in this paper allow for a statistical analysis revealing centers of excellence around the world using programs that are freely available. Based on Web of Science data, field-specific excellence can be identified in cities where highly-cited papers were published significantly. Compared to the mapping approaches published hitherto, our approach is more analytically oriented by allowing the assessment of an observed number of excellent papers for a city (in the sample) against the expected number. Using this test, the approach cannot only identify the top performers in output but the "true jewels." These are cities locating authors who publish significantly more top cited papers than can be expected. As the examples in this paper show for physics, chemistry, and psychology, these cities do not necessarily have a high output of excellent papers.

[1]  Lutz Bornmann,et al.  Is interactive open access publishing able to identify high-impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes , 2011, J. Assoc. Inf. Sci. Technol..

[2]  Ludo Waltman,et al.  Software survey: VOSviewer, a computer program for bibliometric mapping , 2009, Scientometrics.

[3]  Bruce M. King,et al.  Statistical Reasoning in the Behavioral Sciences , 2007 .

[4]  Ismael Rafols,et al.  Content-based and algorithmic classifications of journals: Perspectives on the dynamics of scientific communication and indexer effects , 2009 .

[5]  Dag W. Aksnes,et al.  Scientific Productivity and Group Size: A Bibliometric Analysis of Norwegian Microbiological Research , 2004, Scientometrics.

[6]  Thed N. van Leeuwen,et al.  Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of individual researchers , 2009 .

[7]  Jarno Hoekman,et al.  Spatial scientometrics: Towards a cumulative research program , 2009, J. Informetrics.

[8]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[9]  Graham Thornicroft,et al.  Fair assessment of the merits of psychiatric research , 2007, British Journal of Psychiatry.

[10]  Koenraad Debackere,et al.  Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance , 2008, Scientometrics.

[11]  Veljko Jeremic,et al.  A fresh approach to evaluating the academic ranking of world universities , 2011, Scientometrics.

[12]  Werner Marx,et al.  Vitaly L. Ginzburg—A Bibliometric Study , 2007 .

[13]  Thed N. van Leeuwen,et al.  Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? , 2002, Scientometrics.

[14]  Gualberto Buela-Casal,et al.  Comparative study of international academic rankings of universities , 2007, Scientometrics.

[15]  Ismael Rafols,et al.  A global map of science based on the ISI subject categories , 2009 .

[16]  C. Wagner,et al.  The New Invisible College , 2009 .

[17]  Lutz Bornmann,et al.  A multilevel modelling approach to investigating the predictive validity of editorial decisions: do the editors of a high profile journal select manuscripts that are highly cited after publication? , 2011 .

[18]  Catherine Dehon,et al.  Uncovering excellence in academic rankings: a closer look at the Shanghai ranking , 2009, Scientometrics.

[19]  Werner Marx,et al.  Special features of historical papers from the viewpoint of bibliometrics , 2011, J. Assoc. Inf. Sci. Technol..

[20]  Annette Winkel Schwarz,et al.  The Top-level Global Research System, 1997-99: Centres, Networks and Nodality. An Analysis Based on Bibliometric Indicators , 2002 .

[21]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[22]  Jean-Charles Billaut,et al.  Should you believe in the Shanghai ranking? , 2010, Scientometrics.