Evaluation in Distance Education and E-Learning: The Unfolding Model

Part 1. Why Do We Need a New Approach to Evaluation in Distance Education and E-learning? Distance Education versus E-Learning. The Rapid Expansion of Distance Education and E-Learning. What Is Evaluation? Why Do We Need a Professional Approach to Evaluation? What Does a Professional Approach to Evaluation Look Like? Responding to the Call for a Professional Evaluation Approach: The Unfolding Model. Conclusions: Our Approach to Evaluation. Part 2. The Theory and Practice of Program Evaluation. Why Are Program Evaluation Models Important? Classification Frameworks for Program Evaluation Models. Alkin and Christie's Evaluation Tree: The Roots and Branches. Where Do We Diverge from Alkin and Christie? Conclusions. Part 3. Evaluation Theory and Practice in Distance Education and E-Learning. Evaluation Theory. Models with Scientific Evidence in the Foreground. Models Based on Evidence, Values, and Consequences. Models Based on Messick's (1989) Framework. A Summary of Evaluation Models in Distance Education. Evaluation Studies. Evaluation Practice. Do Unintended Consequences Emerge in Authentic Evaluation Studies? Conclusions. Part 4. Messick's Framework: What Do Evaluators Need to Know? The Overlap between Test Validity and Program Evaluation. Messick's Contributions. Messick's Framework. The Overlap among the Four Facets. The Controversy over Unintended Consequences. Implications for Evaluation. Conclusions. Part 5. Getting Started. Planning the Evaluation Study. The Ethics Review Process. The Political Context of Evaluation. Using the Unfolding Model as a "Road Map." Mixed Methods: Blending Quantitative and Qualitative Data. What Is Essential to Our Approach? Tailoring the Unfolding Model to Your Needs. Conclusions. Part 6. The Unfolding Model: Scientific Evidence. Definition of "Scientific Evidence." Scientific Evidence. How to Write Good Survey Questions. Using the Unfolding Model to Write Survey and Interview Questions. Administering Surveys. Analyzing Survey Data. Qualitative Data: Interviews, Focus Groups, and Online Ethnographies. Qualitative Data Analysis. Outcomes. The Evaluation of Environmental Quality. Relevance. Cost-Benefit Analysis. Bringing It All Together: Mixed Methods. Conclusions. Part 7. The Unfolding Model: Values and Consequences. Underlying Values. How to Identify the Values Underlying Your Course. Course Goals and Objectives. Writing Survey/Interview Questions about Underlying Values. Analyzing Data on Underlying Values. Unintended Consequences. How Can You Identify Unintended Consequences? Writing Survey/Interview Questions about Unintended Consequences. Analyzing Data on Unintended Consequences. How to Enhance the Validity of Your Findings. Recommendations for Course Improvement. Writing the Evaluation Report. Conclusions. Part 8. Findings from Two Authentic Case Studies. Methods and Procedures for Both Studies. Distance Learning: Computing Science 200 (CPSC 200). E-Learning: Professional Writing 110 (PWRIT 110). Conclusions. Part 9. Bringing It All Together. Using Messick's Framework to Evaluate Distance and E-Learning Courses. Using the Unfolding Model to Evaluate Your Courses. Conducting Your Evaluation Study. What Have We Learned from Two Case Studies? E-Learning and Beyond: Is the Unfolding Model the Last Word? The Future of Distance Education and E-Learning. The Future of the Unfolding Model. Conclusions. Appendix A: Summary of the 1994 Program Evaluation Standards. Appendix B: Glossary. Appendix C: List of Associations.