Threats to Internal Validity in Worksite Health Promotion Program Research: Common Problems and Possible Solutions

Reviews of the research on worksite health promotion programs reveal that most studies are limited in their ability to draw clear inferences about program effects because the studies employed flawed research designs and/or analyses. Conclusions are often drawn about program effectiveness with little consideration given to alternative explanations for the findings. In an effort to promote improved research, this article uses the Cook and Campbell delineation of threats to valid causal inference to illustrate how the threats can operate in worksite health promotion program research as well as how they can be examined and controlled. Researchers, even those attempting to conduct true experiments, must consider the existence of all plausible threats to validity and control or rule them out before valid causal inferences can be drawn. The theoretical and design issues involved in worksite health promotion program research are presented, followed by a discussion of threats to internal validity.

[1]  J. Hollis,et al.  Implementing a Year-Long, Worksite-Based Incentive Program for Smoking Cessation , 1991, American journal of health promotion : AJHP.

[2]  E. Wood,et al.  An Evaluation of Lifestyle Risk Factors and Absenteeism after Two Years in a Worksite Health Promotion Program , 1989, American journal of health promotion : AJHP.

[3]  T G Robins,et al.  Hazard Communication in a Large U.S. Manufacturing Firm: The Ecology of Health Education in the Workplace , 1988, Health education quarterly.

[4]  M Gochfeld,et al.  Evaluation of a work site relaxation training program using ambulatory blood pressure monitoring. , 1989, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[5]  A. King,et al.  Increasing exercise among blue-collar employees: the tailoring of worksite programs to meet specific needs. , 1988, Preventive medicine.

[6]  K. Conrad,et al.  Effect of Worksite Health Promotion Programs on Employee Absenteeism , 1990, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[7]  S. Vernon,et al.  Comparison of participants and nonparticipants in a work site cancer awareness and screening program. , 1989, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[8]  R. Glasgow,et al.  A worksite smoking modification competition: potential for public health impact. , 1986, American journal of public health.

[9]  D. Mulvaney,et al.  Work-site health promotion. Five-year trend in employee health care costs. , 1985, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[10]  S. Blair,et al.  A public health intervention model for work-site health promotion. Impact on exercise and physical fitness in a health promotion plan after 24 months. , 1986, JAMA.

[11]  R F Boruch,et al.  Randomized Field Experiments for Program Planning, Development, and Evaluation , 1978, Evaluation quarterly.

[12]  K. Lorig,et al.  A Workplace Health Education Program That Reduces Outpatient Visits , 1985, Medical care.

[13]  F. M. Kramer,et al.  Payroll contracting for smoking cessation: a worksite pilot study. , 1988, American journal of preventive medicine.

[14]  K. Brown,et al.  A flexibility intervention to reduce the incidence and severity of joint injuries among municipal firefighters. , 1990, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[15]  C. Rand,et al.  The effects of contingent payment and frequent workplace monitoring on smoking abstinence. , 1989, Addictive behaviors.

[16]  R. Wolfe,et al.  Economic implications of workplace health promotion programs: review of the literature. , 1988, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[17]  G S Omenn,et al.  A randomized comparison of Worksite-sponsored smoking cessation programs. , 1988, American journal of preventive medicine.

[18]  Kenneth J. Smith,et al.  Problems in the Evaluation of Occupational Health Promotion Programs: A Case Analysis , 1988, American journal of health promotion : AJHP.

[19]  B. Alexy Workplace Health Promotion and the Blue Collar Worker , 1990, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[20]  R. Cottrell,et al.  Do Only the Healthy Intend to Participate in Worksite Health Promotion? , 1988, Health education quarterly.

[21]  R. Shipley,et al.  Effect of the Johnson & Johnson Live for Life program on employee smoking. , 1988, Preventive medicine.

[22]  S. Optenberg,et al.  Reduced disability and health care costs in an industrial fitness program. , 1984, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[23]  A. Steckler The Use of Qualitative Evaluation Methods to Test Internal Validity , 1989 .

[24]  Richard P. Sloan,et al.  Participation in Workplace Health Promotion Programs: The Contribution of Health and Organizational Factors , 1988, Health education quarterly.

[25]  P. Conrad Wellness in the work place: potentials and pitfalls of work-site health promotion. , 1987, The Milbank quarterly.

[26]  B. Flay,et al.  Work site group meetings and the effectiveness of a televised smoking cessation intervention , 1987, American journal of community psychology.

[27]  H. F. Gollob,et al.  Ruling Out Threats To Validity , 1989 .

[28]  M. Vaughn,et al.  The Effect of Progressive Muscle Relaxation on Stress among Clerical Workers , 1989, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[29]  R L Bertera,et al.  The effects of workplace health promotion on absenteeism and employment costs in a large industrial population. , 1990, American journal of public health.

[30]  Gene V. Glass,et al.  The Effect of Experimental Mortality on the Internal and External Validity of the Randomized Comparative Experiment. , 1971 .

[31]  N. Pender,et al.  Building Better Workers , 1987, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[32]  G. Omenn,et al.  Psychosocial predictors of outcome in a worksite smoking cessation program. , 1989, American journal of preventive medicine.

[33]  W. Baun,et al.  A preliminary investigation: effect of a corporate fitness program on absenteeism and health care cost. , 1986, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[34]  The Effects of Health Information in a Worksite Hypertension Screening Program , 1986, Health education quarterly.

[35]  R. Jeffery,et al.  A work-site weight control program using financial incentives collected through payroll deduction. , 1985, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[36]  K. Warner Wellness at the worksite. , 1990, Health affairs.

[37]  J. Telepchak,et al.  Self-Help versus Group Approaches to Smoking Cessation in the Workplace: Eighteen-Month Follow-up and Cost Analysis , 1990, American journal of health promotion : AJHP.

[38]  R G McMurray,et al.  A comparison of two fitness programs to reduce the risk of coronary heart disease in public safety officers. , 1990, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[39]  K. Warner Selling Health Promotion to Corporate America: Uses and Abuses of the Economic Argument , 1987, Health education quarterly.

[40]  R. Glasgow,et al.  Variables associated with participation and outcome in a worksite smoking control program. , 1988, Journal of consulting and clinical psychology.

[41]  B. Flay,et al.  Overcoming Design Problems in Evaluating Health Behavior Programs , 1982, Evaluation & the health professions.

[42]  R C Jones,et al.  Impact of worksite health promotion on health care costs and utilization. Evaluation of Johnson & Johnson's Live for Life program. , 1986, JAMA.

[43]  M. Killeen Health promotion practices of family caregivers. , 1989, Health values.