A strategy for optimizing and evaluating behavioral interventions

Background: Although the optimization of behavioral interventions offers the potential of both public health and research benefits, currently there is no widely agreed-upon principled procedure for accomplishing this.Purpose: This article suggests a multiphase optimization strategy (MOST) for achieving the dual goals of program optimization and program evaluation in the behavioral intervention field.Methods: MOST consists of the following three phases: (a) screening, in which randomized experimentation closely guided by theory is used to assess an array of program and/or delivery components and select the components that merit further investigation; (b) refining, in which interactions among the identified set of components and their interrelationships with covariates are investigated in detail, again via randomized experiments, and optimal dosage levels and combinations of components are identified; and (c) confirming, in which the resulting optimized intervention is evaluated by means of a standard randomized intervention trial. To make the best use of available resources, MOST relies on design and analysis tools that help maximize efficiency, such as fractional factorials.Results: A slightly modified version of an actual application of MOST to develop a smoking cessation intervention is used to develop and present the ideas.Conclusions: MOST has the potential to husband program development resources while increasing our understanding of the individual program and delivery components that make up interventions. Considerations, challenges, open questions, and other potential benefits are discussed.

[1]  Rajiv Vaidyanathan,et al.  Dictionary of statistics and methodology : #a #nontechnical guide for the social sciences , 1994 .

[2]  A FRAMEWORK FOR DEVELOPMENT AND EVALUATION OF RCTs FOR COMPLEX INTERVENTIONS TO IMPROVE HEALTH , 2000 .

[3]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[4]  Susan A. Murphy,et al.  A Conceptual Framework for Adaptive Preventive Interventions , 2004, Prevention Science.

[5]  V. Strecher,et al.  One size does not fit all: The case for tailoring print materials , 1999, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[6]  S. West,et al.  Toward understanding individual effects in multicomponent prevention programs: Design and analysis strategies. , 1997 .

[7]  J. S. Hunter,et al.  Statistics for experimenters : an introduction to design, data analysis, and model building , 1979 .

[8]  J W Cullen,et al.  The scientific approach to cancer control , 1984, CA: a cancer journal for clinicians.

[9]  V. Strecher.  Computer-tailored smoking cessation materials: a review and discussion. , 1999, Patient education and counseling.

[10]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[11]  B. Flay,et al.  Developing School-Based Tobacco Use Prevention and Cessation Programs , 1994 .

[12]  B. Flay.  Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. , 1986, Preventive medicine.

[13]  L. Onken,et al.  Behavioral therapy research: A conceptualization of a process. , 1997 .

[14]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[15]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .