Developing a Tool to Measure Knowledge Exchange Outcomes

This article describes the process of developing measures to assess knowledge exchange outcomes using the dissemination of a best practices in type 2 diabetes document as a specific example. A best practices model consists of knowledge synthesis knowledge exchange (dissemination / adoption) and evaluation stages. Best practices are required at each stage. An extensive literature review found no previous knowledge syntheses of concrete tools and models for evaluating dissemination or exchange strategies. This project developed a practical and usable tool to measure the reach and uptake of disseminated innovations. The instrument itself facilitates an opportunity for knowledge exchange to occur between producers and adopters. At this point the tool has a strong theoretical basis. Initial pilot-testing has begun; however the accumulation of evidence of validity and reliability is only in the planning stages. The instrument described here can be adapted to other areas of population health and evaluation research.

[1]  Robert F. Rich,et al.  Measuring knowledge utilization: Processes and outcomes , 1997 .

[2]  S. Mohammed,et al.  Team mental models in a team knowledge framework: expanding theory and measurement across disciplinary boundaries , 2001 .

[3]  T. Schrecker,et al.  Integrating Knowledge Generation with Knowledge Diffusion and Utilization , 2003 .

[4]  J. Lavis,et al.  How can research organizations more effectively transfer research knowledge to decision makers? , 2003, The Milbank quarterly.

[5]  S. Rosenfield Crafting usable knowledge. , 2000, The American psychologist.

[6]  T. Garvin,et al.  Moving from information transfer to information exchange in health and health care. , 2003, Social science & medicine.

[7]  William N. Dunn,et al.  Measuring Knowledge Use , 1983 .

[8]  Réjean Landry,et al.  The Extent and Determinants of the Utilization of University Research in Government Agencies , 2003 .

[9]  R. Cameron,et al.  Linking Science and Practice: Toward a System for Enabling Communities to Adopt Best Practices for Chronic Disease Prevention , 2001 .

[10]  D. Nutbeam,et al.  Improving the fit between research and practice in health promotion: overcoming structural barriers. , 1996, Canadian journal of public health = Revue canadienne de sante publique.

[11]  Michael S. Goodstadt,et al.  The Interactive Domain Model of Best Practices in Health Promotion: Developing and Implementing a Best Practices Approach to Health Promotion , 2001 .

[12]  Nora Jacobson,et al.  Development of a framework for knowledge translation: understanding user context , 2003, Journal of health services research & policy.

[13]  Christopher J. Bamber,et al.  Measuring teamwork culture: the use of a modified EFQM model , 2003 .

[14]  Knowlton W. Johnson Stimulating Evaluation Use by Integrating Academia and Practice , 1980 .

[15]  Jan Barnsley,et al.  A framework for the dissemination and utilization of research for health-care policy and practice. , 2002, The online journal of knowledge synthesis for nursing.

[16]  Matthew M. Gushta,et al.  Individual determinants of research utilization: a systematic review. , 2003, Journal of advanced nursing.

[17]  C. Estabrooks The conceptual structure of research utilization. , 1999, Research in nursing & health.

[18]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[19]  Nancy J. Cooke,et al.  Measuring Team Knowledge: A Window to the Cognitive Underpinnings of Team Performance , 2003 .

[20]  Russell E. Glasgow,et al.  Evaluating the Relevance, Generalization, and Applicability of Research , 2006, Evaluation & the health professions.

[21]  L W Green,et al.  From research to "best practices" in other settings and populations. , 2001, American journal of health behavior.

[22]  Jack H. Knott,et al.  If Dissemination Is the Solution, What Is the Problem ? , 1980 .

[23]  S. Straus,et al.  Lost in knowledge translation: Time for a map? , 2006, The Journal of continuing education in the health professions.

[24]  Réjean Landry,et al.  Utilization of social science research knowledge in Canada , 2001 .

[25]  G. Hall Measuring Stages of Concern about the Innovation: A Manual for the Use of the SoC Questionnaire. , 1977 .

[26]  Gene E. Hall,et al.  Levels of Use of the Innovation: A Framework for Analyzing Innovation Adoption , 1975 .