Evaluating program effectiveness: creating a reliable and valid tool.

This study was done to assess the reliability of a pretest/ posttest design for a mass-casualty burn disaster continuing education (CE) program. Based on program objectives, an instrument to assess knowledge, skills, confidence, and competence in burn assessment and management was designed. The instrument's internal consistency, split-half reliability, and individual items were analyzed. Measures of reliability were moderately high, and item analysis identified no poorly constructed items. The instrument appears to be a reliable measurement of effectiveness for the CE program and will be consistent in measuring changes based on the training. The results may be useful to others who are planning CE training programs.