Planning for Evaluation in Online Learning: University of Hawaii Case Study

With contemporary requirements for objective measurement, program evaluation is a certain necessity. Most program evaluation is designed in response to external demands for assessment. Moreover, such evaluation is typically developed only after programs already exist. However, the proliferation of online learning provides new opportunities for approaching evaluation. Specifically, many higher education institutions are currently augmenting existing campus-based programs with online learning—either by hybridizing traditional delivery or by providing parallel online options. At the University of Hawaii, while designing a parallel online delivery model for an existing campus-based program, careful consideration was given to the unique requirements for evaluation and assessment. In this way, an overall plan for evaluation was developed that incorporated multiple layers of assessment: from specific programmatic to internal university to external accreditation requirements. Commonalities among the multiple layers were considered to develop a single, overall evaluation approach. In a case study model, this paper describes eight practical steps taken to develop an overall, effective evaluation model.

[1]  David M. Fetterman,et al.  Empowerment evaluation : knowledge and tools for self-assessment & accountability , 1996 .

[2]  Michael P. Menchaca,et al.  Building Community, Linking Islands: A Distance Learning Model from Hawaii , 2007 .

[3]  R. Stake,et al.  Situational evaluation of teaching on campus , 2000 .

[4]  Mary K. Tallent-Runnels,et al.  Teaching Courses Online: A Review of the Research , 2006 .

[5]  Michael P. Menchaca,et al.  Picking Tools for Distance Learning: A View from the Trenches , 2008 .

[6]  A. P. Rovai,et al.  Student evaluation of teaching in the virtual and traditional classrooms: A comparative analysis , 2006, Internet High. Educ..

[7]  Bryan N. Alexander Web 2.0: A New Wave of Innovation for Teaching and Learning? , 2006 .

[8]  E. Allen,et al.  Entering the Mainstream: The Quality and Extent of Online Education in the United State , 2004 .

[9]  Thomas C. Reeves,et al.  Alternative Assessment Approaches for Online Learning Environments in Higher Education , 2000 .

[10]  Francisco Zabaleta,et al.  The use and misuse of student evaluations of teaching , 2007 .

[11]  Yong Zhao,et al.  What Makes the Difference? A Practical Analysis of Research on the Effectiveness of Distance Education , 2005, Teachers College Record: The Voice of Scholarship in Education.

[12]  Ellen Hoffman Opening Communication Channels: Improving an Online Class for Preservice Teachers , 2008 .

[13]  Evaluation of College Teaching in a Community of Practice. , 1999 .

[14]  T. Roberts,et al.  The Development of an Instrument to Evaluate Distance Education Courses Using Student Attitudes , 2005 .