Implementation Research: A Synthesis of the

In the past few years several major reports highlighted the gap between our knowledge of effective treatments and services currently being received by consumers. These reports agree that we know much about interventions that are effective but make little use of them to help achieve important behavioral health outcomes for children families and adults nationally. This theme is repeated in reports by the Surgeon General (United States Department of Health and Human Services 1999; 2001) the National Institute of Mental Health [NIMH] National Advisory Mental Health Council Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment (2001) Bernfeld Farrington & Leschied (2001) Institute of Medicine (2001) and the Presidents New Freedom Commission on Mental Health (2003). The authors call for applied research to better understand service delivery processes and contextual factors to improve the efficiency and effectiveness of program implementation at local state and national levels. Our understanding of how to develop and evaluate evidence-based intervention programs has been furthered by on-going efforts to research and refine programs and practices to define "evidence bases" and to designate and catalogue "evidence-based programs or practices". However the factors involved in successful implementation of these programs are not as well understood. Current views of implementation are based on the scholarly foundations prepared by Pressman & Wildavskys (1973) study of policy implementation Havelock & Havelocks (1973) classic curriculum for training change agents and Rogers (1983; 1995) series of analyses of factors influencing decisions to choose a given innovation. These foundations were tested and further informed by the experience base generated by pioneering attempts to implement Fairweather Lodges and National Follow-Through education models among others. Petersilia (1990) concluded that "The ideas embodied in innovative social programs are not self-executing." Instead what is needed is an "implementation perspective on innovation--an approach that views postadoption events as crucial and focuses on the actions of those who convert it into practice as the key to success or failure". (excerpt)

[1]  M. Lowery.  LAMP in L.A.'s skid row: a model for community-based support services. , 1992, New directions for mental health services.

[2]  R. Menninger.  Administration and policy in mental health , 1993, Administration and Policy in Mental Health and Mental Health Services Research.

[3]  L. K. Gensheimer,et al.  Building an Intervention: A Theoretical and Practical Infrastructure for Planning, Implementing, and Evaluating a Metropolitan-Wide School-To-Career Initiative , 2000 .

[4]  S. Henggeler,et al.  Client-level predictors of adherence to MST in community service settings. , 2003, Family process.

[5]  A. Baker,et al.  Lessons Learned: What the WAY Program Can Teach Us about Program Replication. , 2002 .

[6]  S. Penner,et al.  The role of private-for-profit managed behavioral health in the public sector , 1997, Administration and Policy in Mental Health and Mental Health Services Research.

[7]  D. Reitman,et al.  Association for Advancement of Behavior Therapy , 2005 .

[8]  Dennis D. Embry,et al.  The Good Behavior Game: A Best Practice Candidate as a Universal Behavioral Vaccine , 2002, Clinical child and family psychology review.

[9]  D. Simpson.  A conceptual framework for transferring research to practice. , 2002, Journal of substance abuse treatment.

[10]  Hedy Cleaver,et al.  From policy to practice: the implementation of a new framework for social work assessments of children and families , 2004 .

[11]  H. Colyer,et al.  Evidence-based practice. A philosophical and political analysis: some matters for consideration by professional practitioners. , 1999, Journal of advanced nursing.

[12]  S. Henggeler,et al.  Multisystemic Treatment of Antisocial Behavior in Children and Adolescents , 1998 .

[13]  R. Liberman,et al.  Replication of the Achievement Place model in California. , 1975, Journal of applied behavior analysis.

[14]  P. Griffiths,et al.  The effectiveness of current approaches to workplace stress management in the nursing profession: an evidence based literature review , 2003, Occupational and environmental medicine.

[15]  R. Grol,et al.  Can small group education and peer review improve care for patients with asthma/chronic obstructive pulmonary disease? , 1999, Quality in health care : QHC.

[16]  Katherine Irwin,et al.  Blueprints for Violence Prevention , 2003 .

[17]  T. Farley,et al.  Implementation of condom social marketing in Louisiana, 1993 to 1996. , 1999, American journal of public health.

[18]  Russell Gersten,et al.  Engagement and Disengagement between Special and General Educators: An Application of Miles and Huberman's Cross-Case Analysis , 1998 .

[19]  Eugene R. Oetting,et al.  Community readiness: Research to practice , 2000 .

[20]  M. Guyll,et al.  Two studies of proximal outcomes and implementation quality of universal preventive interventions in a community–university collaboration context , 2002 .

[21]  D. DeGarmo,et al.  Evaluating fidelity: predictive validity for a measure of competent adherence to the Oregon model of parent management training. , 2005, Behavior therapy.

[22]  Paul C. Nutt,et al.  Tactics of Implementation , 1986 .

[23]  H. Liddle,et al.  Transporting a research-based adolescent drug treatment into practice. , 2002, Journal of substance abuse treatment.

[24]  C. Sherbourne,et al.  Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. , 2000, JAMA.

[25]  S. Bakewell-Sachs.  Prenatal and Infancy Home Visitation by Nurses: Recent Findings , 2000 .

[26]  S. Lapinsky,et al.  Practising evidence-based medicine: the design and implementation of a multidisciplinary team-driven extubation protocol , 2001, Critical care.

[27]  Kenneth E. Duckworth,et al.  Consensus Building for the Development of Service Infrastructure for People with Dual Diagnosis , 2004, Administration and Policy in Mental Health and Mental Health Services Research.

[28]  P. Mattessich.  Collaboration: What Makes It Work , 2001 .

[29]  Alan R. Andreasen,et al.  Marketing social change , 1995 .

[30]  Blueprint for Change : Research on Child and Adolescent Mental Health . Report of the National Advisory Mental Health Council ' s Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment , 2022 .

[31]  Karen A. Blase,et al.  A Method for Validating Employment Interviews for Residential Child Care Workers , 1983 .

[32]  M. Gabe.  Mental health: a report of the Surgeon General. , 2000, Home care provider.

[33]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[34]  Carl E. Van Horn,et al.  The Policy Implementation Process: A Conceptual Framework , 1975 .

[35]  Peter A. Heslin,et al.  Training the Trainee as Well as the Trainer: Lessons to Be Learned from Clinical Psychology , 2003 .

[36]  G. Bernfeld.  The Struggle for Treatment Integrity in a "Dis-Integrated" Service Delivery System , 2006 .

[37]  R. Drake,et al.  Implementing evidence-based practices for persons with severe mental illnesses. , 2001, Psychiatric services.

[38]  F. Atherton,et al.  Improving service quality: experience from the Tanzania Family Health Project. , 1999, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[39]  Christopher J. Bamber,et al.  Factors affecting successful implementation of high performance teams , 2001 .

[40]  Mark N. Frolick,et al.  A comparative analysis and review of JIT “implementation” research , 1995 .

[41]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[42]  J. Mckinlay,et al.  Bringing social structure back into clinical decision making. , 1991, Social science & medicine.

[43]  R. Friedman,et al.  A System of Care for Children's Mental Health: Expanding the Research Base. Proceedings of the Annual Research Conference (9th, Tampa, Florida, February 26-28, 1996). , 1995 .

[44]  D. Olds,et al.  Intervention processes as predictors of outcomes in a preventive home-visitation program , 1998 .

[45]  D. Kavanagh,et al.  Supervision Practices in Allied Mental Health: Relationships of Supervision Characteristics to Perceived Impact and Job Satisfaction , 2003, Mental health services research.

[46]  E. McGlynn,et al.  How good is the quality of health care in the United States? , 1998, The Milbank quarterly.

[47]  Patrick J O'Connor,et al.  Key issues in transforming health care organizations for quality: the case of advanced access. , 2004, Joint Commission journal on quality and safety.

[48]  K. Weick.  Organizational Culture as a Source of High Reliability , 1987 .

[49]  S. Henggeler,et al.  A multi-level perspective on the implementation of multisystemic therapy (MST): Attempting dissemination with fidelity. , 2001 .

[50]  M. Barber,et al.  Establishing a community-oriented group home and ensuring its survival: A case study of failure , 1983 .

[51]  M. Beer,et al.  Why change programs don't produce change. , 1990, Harvard business review.

[52]  S. Henggeler,et al.  Implementation of an Empirically Based Drug and Violence Prevention and Intervention Program in Public School Settings , 2001, Journal of clinical child psychology.

[53]  Mark T. Greenberg,et al.  The Study of Implementation: Current Findings From Effective Programs that Prevent Mental Disorders in School-Aged Children , 2000 .

[54]  G. Fairweather.  CHAPTER 7 – Follow-Up Diffusion of the Community Lodge , 1974 .

[55]  Dennis D. Embry,et al.  Community-based prevention using simple, low-cost, evidence-based kernels and behavior vaccines , 2004 .

[56]  Trevor A Sheldon,et al.  What's the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients' notes, and interviews , 2004, BMJ : British Medical Journal.

[57]  Gunter A. Pauli.  Technology Forecasting and Assessment: The Case of Zero Emissions , 1998 .

[58]  Sharon Vaughn,et al.  Bringing Research‐Based Practice in Reading Intervention to Scale , 2003 .

[59]  M. Frommer,et al.  Criteria for evaluating evidence on public health interventions , 2002, Journal of epidemiology and community health.

[60]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[61]  D. Fixsen,et al.  The training and validation of youth-preferred social behaviors of child-care personnel. , 1977, Journal of applied behavior analysis.

[62]  A D Oxman,et al.  No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. , 1995, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[63]  R. Deyle,et al.  Local Government Compliance with State Planning Mandates: The Effects of State Implementation in Florida , 1998 .

[64]  M. T. Forthman,et al.  Insights Into Successful Change Management: Empirically Supported Techniques for Improving Medical Practice Patterns , 2003, American journal of medical quality : the official journal of the American College of Medical Quality.

[65]  P. Pronovost,et al.  Interventions to reduce mortality among patients treated in intensive care units. , 2004, Journal of critical care.

[66]  J. Sheldon,et al.  Ongoing consultation as a method of improving performance of staff members in a group home. , 1992, Journal of applied behavior analysis.

[67]  Craig Anne Heflinger,et al.  Evaluating Managed Mental Health Services: The Fort Bragg Experiment , 1995 .

[68]  D. Gottfredson,et al.  Quality of School-Based Prevention Programs: Results from a National Survey , 2002 .

[69]  P W Corrigan,et al.  Strategies for disseminating evidence-based practices to staff who treat people with serious mental illness. , 2001, Psychiatric services.

[70]  H. Liddle,et al.  Five outpatient treatment models for adolescent marijuana use: a description of the Cannabis Youth Treatment Interventions. , 2002, Addiction.

[71]  M. Wolf,et al.  The analysis and training of rationales for child care workers , 1983 .

[72]  D M Baer,et al.  An implicit technology of generalization. , 1977, Journal of applied behavior analysis.

[73]  A. V. Peterson,et al.  Teacher Training as a Behavior Change Process: Principles and Results from a Longitudinal Study , 2000, Health education & behavior : the official publication of the Society for Public Health Education.

[74]  Yange Xue,et al.  Predictors of Outcome for Children With Behavior Problems Served in Public Mental Health , 2004, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[75]  Minsuk K. Shim,et al.  Whole School Improvement and Restructuring as Prevention and Promotion: Lessons from STEP and the Project on High Performance Learning Communities. , 2001 .

[76]  G. Fairweather.  CHAPTER 8 – Principles for Creating Change in Mental Health Organizations , 1974 .

[77]  D. Dansereau,et al.  Mapping training: the transfer of a cognitive technology for improving counseling. , 2002, Journal of substance abuse treatment.

[78]  N. Jacobson,et al.  Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. , 1993, Journal of consulting and clinical psychology.

[79]  J. Kalafat,et al.  The Implementation and Institutionalization of a School-Based Youth Suicide Prevention Program , 1999, Journal of Primary Prevention.

[80]  M. M. Wolf,et al.  An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders. , 1982, Journal of applied behavior analysis.

[81]  M. French,et al.  Mountains Beyond Mountains: The Quest of Dr. Paul Farmer, a Man Who Would Cure the World , 2003 .

[82]  Charles B. Fleming,et al.  Opening the Black Box: Using Process Evaluation Measures to Assess Implementation and Theory Building , 1999, American journal of community psychology.

[83]  Malcolm J. Morgan,et al.  Systems Implementation Strategy: Behavioural and Organizational Aspects , 1992 .

[84]  D R Becker,et al.  The individual placement and support model of supported employment. , 1996, Psychiatric services.

[85]  William M. K. Trochim,et al.  The use of concept mapping for assessing fidelity of model transfer: An example from psychiatric rehabilitation , 1995 .

[86]  M. Hoge,et al.  Innovation in Behavioral Health Workforce Education , 2004, Administration and Policy in Mental Health and Mental Health Services Research.

[87]  M. Males,et al.  A Failure of Good Intentions: An Analysis of Juvenile Justice Reform in San Francisco during the 1990s , 2004 .

[88]  H. Steadman,et al.  Integration of service systems for homeless persons with serious mental illness through the ACCESS program. Access to Community Care and Effective Services and Supports. , 2002, Psychiatric services.

[89]  W. Williams,et al.  IMPLEMENTATION ANALYSIS AND ASSESSMENT , 1976 .

[90]  B. Chorpita,et al.  Toward Large‐Scale Implementation of Empirically Supported Treatments for Children: A Review and Observations by the Hawaii Empirical Basis to Services Task Force , 2006 .

[91]  P. Gendreau,et al.  The Forgotten Issue in Effective Correctional Treatment: Program Implementation , 1999 .

[92]  R. Gersten,et al.  Factors Enhancing Sustained Use of Research-Based Instructional Practices , 2000, Journal of learning disabilities.

[93]  R. D. de Kemp,et al.  Implemented as intended? Recording family worker activities in a Families First program. , 2004, Child welfare.

[94]  Robert M. Goodman,et al.  Bridging the gap in effective program implementation: From concept to application , 2000 .

[95]  W. Shadish.  Policy research: Lessons from the implementation of deinstitutionalization. , 1984 .

[96]  J. Schofield.  A Model of Learned Implementation , 2004 .

[97]  D. Elliott.  Implementing and evaluating crime prevention and control programs and policies , 1997 .

[98]  P. Gingiss.  Enhancing program implementation and maintenance through a multiphase approach to peer-based staff development. , 1992, The Journal of school health.

[99]  Connie R. Wanberg,et al.  Predictors and outcomes of openness to changes in a reorganizing workplace. , 2000, The Journal of applied psychology.

[100]  D. Satcher.  Report of the Surgeon Generals Conference on Children's Mental Health: A National Action Agenda , 2001 .

[101]  D. Zowghi,et al.  A maturity model for the implementation of software process improvement: an empirical study , 2005, J. Syst. Softw..

[102]  D. Fisher.  The going gets tough when we descend from the ivory tower , 1983 .

[103]  Yin Cheong Cheng,et al.  The strategies for implementing multilevel self‐ management in schools , 1997 .

[104]  M. Crismon,et al.  Evaluation of a schizophrenia medication algorithm in a state hospital. , 2003, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[105]  Laurence J. O'Toole,et al.  PUBLIC POLICY IMPLEMENTATION: EVOLUTION OF THE FIELD AND AGENDA FOR FUTURE RESEARCH , 1987 .

[106]  P. Strain,et al.  DEC Recommended Practices: A Review of 9 Years of EIlECSE Research Literature , 2002 .

[107]  R. Luepker,et al.  Teenage health teaching modules: impact of teacher training on implementation and student outcomes. , 1991, The Journal of school health.

[108]  J. McGuire,et al.  What works in correctional intervention? Evidence and practical implications. , 2001 .

[109]  C. Greenwood,et al.  A Building-Based Case Study of Evidence-Based Literacy Practices , 2003 .

[110]  J. O'Donoghue.  Zimbabwe's AIDS action programme for schools , 2002 .

[111]  Yange Xue,et al.  Use of the CAFAS to Evaluate Outcome for Youths with Severe Emotional Disturbance Served by Public Mental Health , 2004 .

[112]  L. Perry,et al.  Nutritional support in acute stroke: the impact of evidence-based guidelines. , 2003, Clinical nutrition.

[113]  David R. Holtgrave,et al.  Bridging the gap between the science and service of HIV prevention: transferring effective research-based HIV prevention interventions to community AIDS service providers. , 2000, American journal of public health.

[114]  K. Kutash,et al.  A School, Family, and Community Collaborative Program for Children Who Have Emotional Disturbances , 2002 .

[115]  D. Ciliska,et al.  Diffusion and dissemination of evidence-based cancer control interventions. , 2003, Evidence report/technology assessment.

[116]  L. Beutler.  David and Goliath. When empirical and clinical standards of practice meet. , 2000, The American psychologist.

[117]  M. Test,et al.  A model for measuring the implementation of community support programs: Results from three sites , 1992, Community Mental Health Journal.

[118]  D R Becker,et al.  An update on supported employment for people with severe mental illness. , 1997, Psychiatric services.

[119]  John E. Hunter,et al.  Influence of top management commitment on management program success. , 1993 .

[120]  J. Spouse.  Bridging theory and practice in the supervisory relationship: a sociocultural perspective. , 2001, Journal of advanced nursing.

[121]  R. Drake,et al.  Program fidelity in assertive community treatment: development and use of a measure. , 1998, The American journal of orthopsychiatry.

[122]  M. Goggin,et al.  The "Too Few Cases/Too Many Variables" Problem in Implementation Research , 1986 .

[123]  Mary Kay Rayens,et al.  Efficacy of training and fidelity of implementation of the life skills training program. , 2002, The Journal of school health.

[124]  J. Swanson,et al.  Psychosocial Treatment Strategies in the MTA Study: Rationale, Methods, and Critical Issues in Design and Implementation , 2000, Journal of abnormal child psychology.

[125]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[126]  David Satcher,et al.  Mental Health: Culture, Race, and Ethnicity—A Supplement to Mental Health: A Report of the Surgeon General , 2001 .

[127]  John C. Anderson,et al.  Assessing Project Implementation Risk: A Methodological Approach , 1979 .

[128]  D. Fixsen,et al.  Training Techniques for Staff in Group Homes for Juvenile Offenders , 1975 .

[129]  Abdullah S. Al-Mudimigh,et al.  ERP implementation: lessons from a case study , 2003, Inf. Technol. People.

[130]  K. Conrad.  Evaluating Program Environments , 1989 .

[131]  C. Mulrow,et al.  From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative. , 2000, Medical care.

[132]  S. L. Mann,et al.  Experimental design and methods for school-based randomized trials. Experience from the Hutchinson Smoking Prevention Project (HSPP). , 2000, Controlled clinical trials.

[133]  R. L. Post,et al.  Beyond Components: Using Fidelity Scales to Measure and Assure Choice in Program Implementation and Quality Assurance , 2002, Community Mental Health Journal.

[134]  S. Winter,et al.  Replication as Strategy , 2001 .

[135]  N. Reppucci,et al.  Social psychology of behavior modification. Problems of implementation in natural settings. , 1974, The American psychologist.

[136]  G Chase,et al.  Implementing a human services program: how hard will it be? , 1979, Public policy.

[137]  J. Lochman.  The implementation of the Fast Track program: an example of a large-scale prevention science efficacy trial. , 2002, Journal of abnormal child psychology.

[138]  Sharon Brennan,et al.  Mentoring the New Professional in Interdisciplinary Early Childhood Education , 2001 .

[139]  G. Altshuller.  Creativity as an exact science : the theory of the solution of inventive problems , 1984 .

[140]  Dean L. Fixsen,et al.  Procedures for developing training programs in large-scale settings , 1983 .

[141]  R. Drake,et al.  Implementing dual diagnosis services for clients with severe mental illness. , 2001, Psychiatric services.

[142]  Anthony L. Hemmelgarn,et al.  The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. , 1998, Child abuse & neglect.

[143]  Thomas J. Cook,et al.  Avoiding type III error in program evaluation: Results from a field experiment , 1980 .

[144]  R M Goodman,et al.  Evaluation of the Heart to Heart Project: Lessons from a Community-Based Chronic Disease Prevention Project , 1995, American journal of health promotion : AJHP.

[145]  Michelle P. Salyers,et al.  Measurement of Fidelity in Psychiatric Rehabilitation , 2000, Mental health services research.

[146]  P. Chamberlain.  The oregon multidimensional treatment foster care model: Features, outcomes, and progress in dissemination , 2003 .

[147]  Gareth Morgan,et al.  Action Learning: A Holographic Metaphor for Guiding Social Change , 1984 .

[148]  K. S. Park,et al.  Performance obstacles in cellular manufacturing implementation— empirical investigation , 2002 .

[149]  P. Adams.  Marketing social change: The case of family preservation , 1994 .

[150]  J. Herrick.  : From Charity to Enterprise: The Development of American Social Work in a Market Economy , 1990 .

[151]  L. Sechrest,et al.  Critical dimensions in the choice and maintenance of successful treatments: strength, integrity, and effectiveness. , 1981, Journal of consulting and clinical psychology.

[152]  A. Ager,et al.  Issues in the definition and implementation of “best practice” for staff delivery of interventions for challenging behaviour , 2001 .

[153]  Jo Rycroft-Malone,et al.  The PARIHS framework--a framework for guiding the implementation of evidence-based practice. , 2004, Journal of nursing care quality.

[154]  R. Prinz,et al.  Treatment fidelity in outcome studies , 1991 .

[155]  Linda Duxbury.  The corporation of the 1990s: Information technology and organizational transformation , 1993 .

[156]  G. Aarons.  Mental Health Provider Attitudes Toward Adoption of Evidence-Based Practice: The Evidence-Based Practice Attitude Scale (EBPAS) , 2004, Mental health services research.

[157]  D. Fixsen,et al.  Marketing your product: The psychologist as communicator. , 1985 .

[158]  M. Wolf,et al.  A Comparison of Treatment Environments in Community-Based Group Homes for Adolescent Offenders , 1988 .

[159]  George W. Fairweather.  CHAPTER 6 – The Essential Conditions for Activating Adoption , 1974 .

[160]  F. EnWenderK..  Evaluating community mental health services, principles and practiceedited by Isabel Davidoff, Marcia Guttentag, and Joan Offutt. Rockville, Md.: The Staff College, National Institute of Mental Health, 1977, 454 pp. free. (DHEW Publication No. (ADM) 77-465) , 1978 .

[161]  V. Rich.  Personal communication , 1989, Nature.

[162]  S. Palsha,et al.  Improving Quality in Early Childhood Environments Through On-Site Consultation , 1998 .

[163]  Denis O. Gray,et al.  ESID, Dissemination, and Community Psychology: A Case of Partial Implementation? , 2003, American journal of community psychology.

[164]  A. Steckler,et al.  Diffusion of Innovations in Schools: A Study of Adoption and Implementation of School-Based Tobacco Prevention Curricula , 1995, American journal of health promotion : AJHP.

[165]  M. Cray,et al.  A facility-wide consultation and training team as a catalyst in promoting institutional change , 1983 .

[166]  Karen A. Blase,et al.  In Search of Program Implementation: 792 Replications of the Teaching-Family Model , 2007 .

[167]  G. S. MacDuff,et al.  Teaching-Family Model for Autistic Children , 1984 .

[168]  Abigail A. Fagan,et al.  Strategies for enhancing the adoption of school‐based prevention programs: Lessons learned from the Blueprints for Violence Prevention replications of the Life Skills Training program , 2003 .

[169]  R. Drake,et al.  Policy implications for implementing evidence-based practices. , 2001, Psychiatric services.

[170]  S. Altshul,et al.  Alternatives to Mental Hospital Treatment , 1979 .

[171]  H. Hearnshaw,et al.  Changing the clinical behavior of doctors: a psychological framework. , 1996, Quality in health care : QHC.

[172]  Yange Xue,et al.  Outcomes for Children with Problematic Behavior in School and at Home Served By Public Mental Health , 2004 .

[173]  Delbert S. Elliott,et al.  Issues in Disseminating and Replicating Effective Prevention Programs , 2004, Prevention Science.

[174]  R. Drake,et al.  Moving assertive community treatment into standard practice. , 2001, Psychiatric services.

[175]  Thomas F. Green,et al.  Predicting the Behavior of the Educational System , 1981 .

[176]  David P. Farrington,et al.  U.S. Department of Justice Office of Justice Programs Office of Juvenile Justice and Delinquency Prevention , 1999 .

[177]  K. Comtois.  A review of interventions to reduce the prevalence of parasuicide. , 2002, Psychiatric services.

[178]  G. Bond,et al.  Assertive case management in three CMHCs: a controlled study. , 1988, Hospital & community psychiatry.

[179]  H. Ireys,et al.  Reinventing fidelity: The transfer of social technology among settings , 1991, American journal of community psychology.

[180]  S. Henggeler,et al.  Family therapy and beyond : a multisystemic approach to treating the behavior problems of children and adolescents , 1990 .

[181]  T E Backer,et al.  Dissemination and adoption of innovative psychosocial interventions. , 1986, Journal of consulting and clinical psychology.

[182]  B. Rounsaville,et al.  Bridging the gap: a hybrid model to link efficacy and effectiveness research in substance abuse treatment. , 2003, Psychiatric services.

[183]  G. Prem Premkumar,et al.  A Meta-Analysis of Research on Information Technology Implementation in Small Business , 2003, J. Organ. Comput. Electron. Commer..

[184]  J. Burchard.  One Kid at a Time: Evaluative Case Studies and Description of the Alaska Youth Initiative Demonstration Project. , 1993 .

[185]  F. Azocar,et al.  Best practices: dissemination of guidelines for the treatment of major depression in a managed behavioral health care network. , 2001, Psychiatric services.

[186]  D. Olds,et al.  Taking preventive intervention to scale: The nurse-family partnership * , 2003 .

[187]  D. Shapiro,et al.  Therapist treatment fidelity in prescriptive vs. exploratory psychotherapy. , 1993, The British journal of clinical psychology.

[188]  L. Morlock,et al.  Control structure, values, and innovation: a comparative study of hospitals. , 1980, Journal of health and social behavior.

[189]  Walter S. Gilliam,et al.  Evaluating Child and Family Demonstration Initiatives: Lessons from the Comprehensive Child Development Program. , 2000 .

[190]  X Tonesk,et al.  Implementing clinical practice guidelines: social influence strategies and practitioner behavior change. , 1992, QRB. Quality review bulletin.

[191]  Lynn S. Fuchs,et al.  Enhancing First-Grade Children's Mathematical Development with Peer-Assisted Learning Strategies , 2002 .

[192]  Diane Paulsell,et al.  Understanding implementation in Early Head Start programs: Implications for policy and practice , 2002 .

[193]  Joseph E. Zins,et al.  Consulting to Facilitate Planned Organizational Change in Schools , 1995 .

[194]  S. Schoenwald,et al.  Effectiveness, transportability, and dissemination of interventions: what matters when? , 2001, Psychiatric services.

[195]  P. Monaghan,et al.  Implementing a community-based social marketing project to improve agricultural worker health. , 2001, Environmental health perspectives.

[196]  J. M. Beyer,et al.  The Utilization Process: A Conceptual Framework and Synthesis of Empirical Findings. , 1982 .

[197]  S. Johnson,et al.  Empirically supported psychosocial interventions for children: an overview. , 1998, Journal of clinical child psychology.

[198]  M. Trivedi,et al.  The status of evidence-based guidelines and algorithms in the treatment of depression , 2002 .

[199]  Karen A. Blase,et al.  Creating new realities: program development and dissemination. , 1993, Journal of applied behavior analysis.

[200]  Jaideep Motwani,et al.  Successful implementation of TPS in a manufacturing setting: a case study , 1997 .

[201]  Curtis J. Braukmann,et al.  Developing and transferring behavioral technologies for children and youth , 1981 .

[202]  Sue Scott,et al.  Implementation of a teacher-delivered sex education programme: obstacles and facilitating factors. , 2002, Health education research.

[203]  Dejan S. Milojicic,et al.  Process migration , 1999, ACM Comput. Surv..

[204]  S. Henggeler,et al.  Multisystemic Treatment of Substance-Abusing and -Dependent Delinquents: Outcomes, Treatment Fidelity, and Transportability , 1999, Mental health services research.

[205]  R. Felner.  The Project on High Performance Learning Communities: Applying the Land-Grant Model to School Reform. , 1997 .

[206]  Kendon J. Conrad,et al.  Evaluating Program Environments. New Directions for Program Evaluation , 1988 .

[207]  R. McDermott.  Why Information Technology Inspired but Cannot Deliver Knowledge Management , 1999 .

[208]  K. Hodges,et al.  The role of monitoring outcomes in initiating implementation of evidence-based treatments at the state level. , 2004, Psychiatric services.

[209]  Ronald G. Havelock,et al.  Training for change agents , 1973 .

[210]  S. Fawcett,et al.  A review of collaborative partnerships as a strategy for improving community health. , 2000, Annual review of public health.

[211]  D. Olds.  Prenatal and Infancy Home Visiting by Nurses: From Randomized Trials to Community Replication , 2002, Prevention Science.

[212]  K. Gansle,et al.  Treatment integrity in applied behavior analysis with children. , 1993, Journal of applied behavior analysis.

[213]  D. Simpson,et al.  A conceptual framework for drug treatment process and outcomes. , 2004, Journal of substance abuse treatment.

[214]  M. Fine,et al.  Implementation of an evidence-based guideline to reduce duration of intravenous antibiotic therapy and length of stay for patients hospitalized with community-acquired pneumonia: a randomized controlled trial. , 2003, The American journal of medicine.

[215]  H. Atherton,et al.  Sustaining the implementation of an evidence-based guideline for bronchiolitis. , 2000, Archives of pediatrics & adolescent medicine.

[216]  Alexander L. Miller,et al.  The Texas Medication Algorithm Project: development and implementation of the schizophrenia algorithm. , 1999, Psychiatric services.

[217]  T H Ollendick,et al.  Empirically supported psychological interventions: controversies and evidence. , 2001, Annual review of psychology.

[218]  A. Bjørndal,et al.  Many A Slip Between Cup And Lip , 2003, Evaluation review.

[219]  M. H. Epstein,et al.  Reliability of the Wraparound Observation Form: An Instrument to Measure the Wraparound Process , 1998 .

[220]  Russell Gersten,et al.  When Less May Be More: A 2‐Year Longitudinal Evaluation of a Volunteer Tutoring Program Requiring Minimal Training , 2000 .

[221]  Benjamin L. Crosby,et al.  Stakeholder Analysis: A Vital Tool for Strategic Managers , 1993 .

[222]  John A. Morris,et al.  Training and Education Needs of Consumers, Families, and Front-Line Staff in Behavioral Health Practice , 2002, Administration and Policy in Mental Health and Mental Health Services Research.

[223]  S. Ennett,et al.  How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations. , 1994, American journal of public health.

[224]  Robert E Drake,et al.  Implementing Evidence-Based Practices for People with Severe Mental Illness , 2003, Behavior modification.

[225]  P. Chamberlain,et al.  Enhanced services and stipends for foster parents: effects on retention rates and outcomes for children. , 1992, Child welfare.

[226]  S. Henggeler,et al.  Mechanisms of change in multisystemic therapy: reducing delinquent behavior through therapist adherence and improved family and peer functioning. , 2000, Journal of consulting and clinical psychology.

[227]  R. Drake,et al.  Evaluating use of continuous treatment teams for persons with mental illness and substance abuse. , 1995, Psychiatric services.

[228]  C. Webster-Stratton.  Early intervention with videotape modeling: Programs for families of children with oppositional defiant disorder or conduct disorder. , 1996 .

[229]  Michelle P. Salyers,et al.  Measuring the fidelity of implementation of a mental health program model. , 1994, Journal of consulting and clinical psychology.

[230]  J. Borghi,et al.  Is hygiene promotion cost‐effective? A case study in Burkina Faso , 2002, Tropical medicine & international health : TM & IH.

[231]  P. Strain,et al.  Evidence-Based Practice in Early Intervention/Early Childhood Special Education: Single-Subject Design Research , 2002 .

[232]  Hayley Carter.  Re‐engineering in practice , 1998 .

[233]  A. Charles Catania,et al.  Handbook of applied behavior analysis: Social and instructional processes , 1978 .

[234]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[235]  Michael G. Boyle,et al.  What Works for Mental Health System Change: Evolution or Revolution? , 2003, Administration and Policy in Mental Health and Mental Health Services Research.

[236]  The Diffusion of an Innovation in Indonesia , 1994 .

[237]  James D. Westphal,et al.  Customization or Conformity? An Institutional and Network Perspective on the Content and Consequences of TQM Adoption , 1997 .

[238]  J. Fox,et al.  The World Bank and social capital: Lessons from ten rural development projects in the Philippines and Mexico , 2000 .

[239]  J. F. Alexander,et al.  Short-term family intervention: a therapy outcome study. , 1973, Journal of consulting and clinical psychology.

[240]  D. E. Weber.  Neighborhood entry in group home development. , 1978, Child welfare.

[241]  V. Ganju.  Implementation of evidence-based practices in state mental health systems: implications for research and effectiveness studies. , 2003, Schizophrenia bulletin.

[242]  H. Adelman,et al.  SCALING-UP REFORMS ACROSS A SCHOOL DISTRICT , 1999 .

[243]  T. Sexton,et al.  Family-Based Empirically Supported Interventions , 2002 .

[244]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[245]  D. Connell,et al.  Summary of findings of the School Health Education Evaluation: health promotion effectiveness, implementation, and costs. , 1985, The Journal of school health.

[246]  George W. Fairweather,et al.  Innovation and Social Process: A National Experiment in Implementing Social Technology , 1980 .

[247]  J. Connell,et al.  You can get there from here: Using a theory of change approach to plan urban education reform. , 2000 .

[248]  David Tranfield,et al.  The Implementation Cube for Advanced Manufacturing Systems , 1989 .

[249]  M. Boelaert,et al.  Through Mintzberg's glasses: a fresh look at the organization of ministries of health. , 2000, Bulletin of the World Health Organization.

[250]  S. Henggeler,et al.  Multisystemic therapy: monitoring treatment fidelity. , 2000, Family process.

[251]  E. Nelson,et al.  Microsystems in health care: Part 8. Developing people and improving work life: what front-line staff told us. , 2003, Joint Commission journal on quality and safety.

[252]  John Crawford,et al.  Key factors predicting effectiveness of cultural change and improved productivity in implementing total quality management , 1999 .

[253]  D. Berlowitz,et al.  Adherence to Pressure Ulcer Prevention Guidelines: Implications for Nursing Home Quality , 2003, Journal of the American Geriatrics Society.

[254]  John D. Voss,et al.  Randomized controlled trial of education and feedback for implementation of guidelines for acute low back pain , 2003, Journal of General Internal Medicine.

[255]  Janette K. Klingner,et al.  Barriers and Facilitators in Scaling up Research-Based Practices , 2003 .

[256]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[257]  K. V. Sambasivarao,et al.  Selection and implementation of advanced manufacturing technologies , 1995 .

[258]  R. Feldman,et al.  The St. Louis conundrum : the effective treatment of antisocial youths , 1984 .

[259]  S B Stolz,et al.  Adoption of innovations from applied behavioral research: "Does anybody care?". , 1981, Journal of applied behavior analysis.

[260]  Michael W. Arthur,et al.  Bridging the gap between science and practice in drug abuse prevention through needs assessment and strategic community planning , 2000 .

[261]  Maryam Alavi,et al.  Revisiting DSS Implementation Research: A Meta-Analysis of the Literature and Suggestions for Researchers , 1992, MIS Q..

[262]  R. Dillingham.  Mountains Beyond Mountains: The Quest of Dr Paul Farmer, A Man Who Would Cure the World , 2004 .

[263]  Godwin J. Udo,et al.  Advanced manufacturing technologies: Determinants of implementation success , 1996 .

[264]  Curtis J. Braukmann,et al.  Work environment in relation to employee job satisfaction in group homes for youths , 1979 .

[265]  J. Schumaker,et al.  The Training and Validation of Behavior Observation and Description Skills , 1978 .

[266]  D. Fixsen,et al.  Structure of child care education: Issues and implications for educators and practitioners , 1981 .

[267]  C. Perrow.  A FRAMEWORK FOR THE COMPARATIVE ANALYSIS OF ORGANIZATIONS , 1967 .

[268]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[269]  R. Drake,et al.  Implementing supported employment as an evidence-based practice. , 2001, Psychiatric services.

[270]  J. Weisz,et al.  Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. , 1995, Journal of consulting and clinical psychology.

[271]  S. Schoenwald,et al.  Dissemination of assertive community treatment programs. , 1995, Psychiatric services.

[272]  Thomas J. Smith,et al.  Youth Development in Community Settings: Challenges to Our Field and Our Approach , 2001 .

[273]  Consumer feedback in human service programs , 1981 .

[274]  R. Grol,et al.  Practice visits as a tool in quality improvement: mutual visits and feedback by peers compared with visits and feedback by non-physician observers. , 1999, Quality in Health Care.

[275]  S. Carpinello,et al.  Best Practices: New York state's campaign to implement evidence-based practices for people with serious mental disorders. , 2002, Psychiatric services.

[276]  Cathaleene Macias,et al.  Strategic Planning for ICCD Clubhouse Implementation: Development of the Clubhouse Research and Evaluation Screening Survey (CRESS) , 2001, Mental health services research.

[277]  M. Kapp.  PRESERVATION OF CLIENT RIGHTS: A HANDBOOK FOR PRACTITIONERS PROVIDING THERAPEUTIC, EDUCATIONAL, AND REHABILITATIVE SERVICES—edited by Gerald T. Hannah, Ph.D., Walter P. Christian, Ph.D., and Hewitt B. Clark, Ph.D.; Free Press, New York, 1981, 426 pages, $25 , 1982 .

[278]  M. H. Small,et al.  Human factors in the adoption and performance of advanced manufacturing technology in unionized firms , 2000, Ind. Manag. Data Syst..

[279]  T. Paulussen,et al.  Determinants of innovation within health care organizations: literature review and Delphi study. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[280]  P. Flynn,et al.  The federal role in drug abuse technology transfer: a history and perspective. , 2002, Journal of substance abuse treatment.

[281]  R. Rosenheck,et al.  Organizational process: a missing link between research and practice. , 2001, Psychiatric services.

[282]  P. Puska,et al.  Community intervention in cardiovascular health promotion: North Karelia, 1972–1999. , 2001 .

[283]  Michael J. Smith,et al.  Implementing New Technology , 2004 .

[284]  K. Schneider,et al.  An analysis of the effects of implementing the teaching-family model in two community-based group homes , 1982 .

[285]  Mario Hernandez,et al.  Building Upon the Theory of Change for Systems of Care , 2003 .

[286]  Alexander L. Miller,et al.  A quality improvement process for implementing the Texas algorithm for schizophrenia in Ohio. , 2003, Psychiatric services.

[287]  T. Frieden,et al.  Rapid DOTS expansion in India. , 2002, Bulletin of the World Health Organization.

[288]  E. Sogolow,et al.  A technology transfer model for effective HIV/AIDS interventions: science and practice. , 2000, AIDS education and prevention : official publication of the International Society for AIDS Education.

[289]  Curtis J. Braukmann,et al.  The relationship between parent-youth interaction and delinquency in group homes , 1981, Journal of abnormal child psychology.

[290]  David P. Farrington,et al.  Offender Rehabilitation in Practice: Implementing and Evaluating Effective Programs , 2001 .

[291]  D. Simpson,et al.  Assessing organizational readiness for change. , 2002, Journal of substance abuse treatment.

[292]  B. Joyce,et al.  The Evolution of Peer Coaching , 1996 .

[293]  Abraham Wandersman,et al.  Community Science: Bridging the Gap between Science and Practice with Community-Centered Models , 2003, American journal of community psychology.

[294]  S. Henggeler,et al.  Multisystemic therapy with violent and chronic juvenile offenders and their families: the role of treatment fidelity in successful dissemination. , 1997, Journal of consulting and clinical psychology.

[295]  L. Dixon,et al.  Services to families of adults with schizophrenia: from treatment recommendations to dissemination. , 1999, Psychiatric services.

[296]  Linda Taylor,et al.  On Sustainability of Project Innovations as Systemic Change , 2003 .

[297]  Christian Korunka,et al.  Effects of new technologies with special regard for the implementation process per se , 1993 .

[298]  A Kitson,et al.  Enabling the implementation of evidence based practice: a conceptual framework. , 1998, Quality in health care : QHC.

[299]  S. Henggeler,et al.  Investigating family-based alternatives to institution-based mental health services for youth: lessons learned from the pilot study of a randomized field trial. , 1997, Journal of clinical child psychology.

[300]  T. Anderson,et al.  Psychosocial Treatments for Child and Adolescent Disorders: Empirically Based Strategies for Clinical Practice , 1998 .

[301]  M. Salanova,et al.  Information technology implementation styles and their relation with workers’ subjective well‐being , 2004 .

[302]  Joann L. Robinson,et al.  Home visiting by paraprofessionals and by nurses: a randomized, controlled trial. , 2002, Pediatrics.

[303]  Russell E. Glasgow,et al.  Work Site Health Promotion Research: To what Extent can we Generalize the Results and what is Needed to Translate Research to Practice? , 2003, Health education & behavior : the official publication of the Society for Public Health Education.

[304]  R. Rosenheck,et al.  Multisite experimental cost study of intensive psychiatric community care. , 1995, Schizophrenia bulletin.

[305]  Everett M. Rogers,et al.  Diffusion of innovations (5. ed.) , 2003 .

[306]  E. Larson,et al.  Evaluation of Staff Performance , 1971 .

[307]  Louise Fitzgerald,et al.  Innovation in healthcare: how does credible evidence influence professionals? , 2003, Health & social care in the community.