Measuring the Degree of Program Implementation

This paper discusses conceptual and methodological issues surrounding the measurement of the construct, degree of implementation, drawn from a review of 74 previous studies which included such measures. Assessments against five measurement criteria indicate that an adequate scientific basis has not been established for this construct. We suggest that future improvement in its measurement will result from an analysis of the characteristics of the innovation being implemented, particularly whether users are individuals or coordinated work groups.

[1]  Charles A. Murray.  UDIS: Deinstitutionalizing the Chronic Juvenile Offender. , 1978 .

[2]  D. Connell,et al.  Evaluation of the Child and Family Resource Program , 1980 .

[3]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[4]  George W. Fairweather,et al.  Innovation and Social Process: A National Experiment in Implementing Social Technology , 1980 .

[5]  Louis G. Tornatzky,et al.  2 – Social Process and Social Innovation , 1980 .

[6]  R. M. Burger,et al.  RANN utilization experience (case studies 22 through 31). Final report , 1976 .

[7]  Robert K. Yin,et al.  Changing urban bureaucracies : how new practices become routinized , 1978 .

[8]  M. A. Scheirer,et al.  Approaches to the study of implementation , 1983, IEEE Transactions on Engineering Management.

[9]  D. Reid,et al.  Teaching foster grandparents to train severely handicapped persons. , 1978, Journal of applied behavior analysis.

[10]  Janice M. Beyer,et al.  Implementing Change: Alcoholism Policies in Work Organizations , 1978 .

[11]  Louise B. Russell,et al.  Technology in Hospitals: Medical Advances and Their Diffusion , 1980 .

[12]  G. Fairweather.  CHAPTER 8 – Principles for Creating Change in Mental Health Organizations , 1974 .

[13]  J. J. Mitchell.  Implementing Welfare-Employment Programs: An Institutional Analysis of the Work Incentive (WIN) Program. , 1980 .

[14]  E. Schaps.  A Process and Outcome Evaluation of an Affective Teacher Training Primary Prevention Program. , 1980 .

[15]  B. Gold,et al.  Evaluating technological innovations: Methods, expectations, and findings , 1980 .

[16]  C. Coogler,et al.  Foundations of Behavioral Research 2nd ed , 1974 .

[17]  Harold B. Pepinsky,et al.  Creating change in mental health organizations. , 1975 .

[18]  J. Cone,et al.  Multiple-baseline analysis of a token economy for psychiatric inpatients. , 1979, Journal of applied behavior analysis.

[19]  G. Hall,et al.  Innovation Configurations: Analyzing the Adaptations of Innovations. , 1978 .

[20]  J. Wholey.  Evaluation--promise and performance , 1979 .

[21]  Jerome Johnston,et al.  An Evaluation of Freestyle: a television series to reduce sex-role stereotypes , 1980 .

[22]  J S Bailey,et al.  Measuring client gains from staff-implemented programs. , 1978, Journal of applied behavior analysis.

[23]  Eva Lantos Rezmovic.  Program implementation and evaluation results: A reexamination of type III error in a field experiment , 1982 .

[24]  A. Kaluzny,et al.  Attributes of health services as factors in program implementation. , 1973, Journal of health and social behavior.

[25]  D. Campbell,et al.  Unobtrusive Measures: Nonreactive Research in the Social Sciences , 1966 .

[26]  J. Opie.  Promise and performance : choosing and implementing an environmental policy , 1981 .

[27]  Joseph B. Giacquinta,et al.  Implementing organizational innovations : a sociological analysis of planned educational change , 1971 .

[28]  M. Lipsky,et al.  Street-Level Bureaucrats and Institutional Innovation: Implementing Special-Education Reform , 1977 .

[29]  Mary Ann Scheirer,et al.  Program Implementation: The Organizational Context , 1981 .

[30]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[31]  T C Ryan.  Blocks to Effective Technology Transfer in Construction. , 1978 .

[32]  M. Mclaughlin,et al.  Federal Programs Supporting Educational Change, Vol. VIII: Implementing and Sustaining Innovations. , 1978 .

[33]  Russell Gersten,et al.  Measuring Implementation of a Structured Educational Model in an Urban School District: An Observational Approach , 1982 .

[34]  M. A. Scheirer.  Program Participants' Positive Perceptions , 1978 .

[35]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .