Applying a Capability Maturity Model (CMM) to evaluate global health security-related research programmes in under-resourced areas

Abstract Organisations in under-resourced areas that achieve long-term research sustainability by successfully competing for research funding will not only build their reputation for conducting quality science but also develop their human resources in a manner that reduces the risk of becoming a future security threat. Major challenges to these organisations include identifying and prioritising funding opportunities, securing and administering external grant awards and publishing both the outcomes of research and relevant surveillance data. Lack of a standardised evaluation technique to assess institutional research capabilities poses challenges for identifying and targeting specific, repeatable processes that lead to organisational improvements. Short- and long-term goals, which are challenged by research quality, funding and human resources, need to be established in order to achieve complex missions such as reducing global health security threats. Once baseline capabilities are established, a consistent evaluation technique provides an objective view to complement other steps that enhance capabilities. The capability maturity model, which is often used in business and technology sectors for establishing life cycle and planning sustainment, is a technique that enhances performance by defining three levels of capability (initial, managed and optimised). An organisation can assess its current state of capability (‘as is’) and develop an actionable strategy for its next progression (‘to be’). In addition, application of a CMM aids creation of a strategy for realising a more repeatable and optimised process. Research programmes frequently rely on basic metrics such as the number of peer-reviewed publications and grant funding awards to measure their quality. Our analysis suggests an approach that includes references and tools, especially those that are risk-based, which can be used to establish initial best practices, define metrics, measure outputs and rates of success in a stepwise manner. In addition, we provide a pilot example from a survey of research institutes in under-resourced areas.

[1]  C. Tardy The role of English in scientific communication: Lingua franca or Tyrannosaurus rex? , 2004 .

[2]  Jason Priem Scholarship: Beyond the paper , 2013, Nature.

[3]  Jing Chen,et al.  Language and rigour in qualitative research: Problems and principles in analyzing data collected in Mandarin , 2008, BMC medical research methodology.

[4]  H. Badrane,et al.  Biomedical research in developing countries: the case of Morocco in the 1990s. , 2003, La Tunisie medicale.

[5]  Vincent Larivière,et al.  Changes in publication languages and citation practices and their effect on the scientific impact of Russian science (1993-2010) , 2012, J. Assoc. Inf. Sci. Technol..

[6]  Behnam Shakiba,et al.  BMC Medical Research Methodology BioMed Central Correspondence , 2006 .

[7]  Cheng-Chen Lin,et al.  Cultural and leadership predictors of corporate social responsibility values of top management: a GLOBE study of 15 countries , 2006, Journal of International Business Studies.

[8]  Henry H. Willis,et al.  Measuring Cooperative Biological Engagement Program (CBEP) Performance: Capacities, Capabilities, and Sustainability Enablers for Biorisk Management and Biosurveillance , 2014 .

[9]  W. Edwards Deming,et al.  A History of the Capability Maturity Model for Software , 2009 .

[10]  O. Uthman,et al.  Geography of Africa biomedical publications: An analysis of 1996–2005 PubMed papers , 2007, International journal of health geographics.

[11]  Barry Smith,et al.  Beyond the paper , 2021, Nature Ecology & Evolution.

[12]  S. Diepeveen,et al.  RESEARCH CAPACITY‐BUILDING IN AFRICA: NETWORKS, INSTITUTIONS AND LOCAL OWNERSHIP , 2013 .

[13]  María Bordons,et al.  Towards a single language in science? A Spanish view , 2004 .

[14]  Deana Pennington,et al.  Scientific Collaborations: How Do We Measure the Return on Relationships? , 2016, Front. Public Health.

[15]  H. Benamer,et al.  Arab nations lagging behind other Middle Eastern countries in biomedical research: a comparative study , 2009, BMC Medical Research Methodology.

[16]  Jonathan Grant,et al.  Measuring research: A guide to research evaluation frameworks and tools , 2013 .

[17]  D. Rohra Representation of less-developed countries in Pharmacology journals: an online survey of corresponding authors , 2011, BMC medical research methodology.

[18]  A. Bortolus Running Like Alice and Losing Good Ideas: On the Quasi-Compulsive Use of English by Non-native English Speaking Scientists , 2012, AMBIO.

[19]  Tsuguya Fukui,et al.  Biomedical publication--global profile and trend. , 2003, Public health.

[20]  Isabel Gómez,et al.  Towards a single language in science ? , 2009 .

[21]  Michel Zitt,et al.  The Transition from "National" to "Transnational" Model and Related Measures of Countries' Performance , 1998, J. Am. Soc. Inf. Sci..

[22]  Alain Bernard,et al.  Organizational capabilities assessment: a dynamic methodology, methods and a tool for supporting organizational diagnosis , 2010 .

[23]  Kenneth B Yeh,et al.  National Laboratory Planning: Developing Sustainable Biocontainment Laboratories in Limited Resource Areas. , 2016, Health security.