Structure, Content, Delivery, Service, and Outcomes: Quality e-Learning in higher education

This paper addresses the need for quality e-Learning experiences. We used the Demand-Driven Learning Model (MacDonald, Stodel, Farres, Breithaupt, and Gabriel, 2001) to evaluate an online Masters in Education course. Multiple data collection methods were used to understand the experiences of stakeholders in this case study: the learners, design team, and facilitators. We found that all five dimensions of the model (structure, content, delivery, service, and outcomes) must work in concert to implement a quality e-Learning course. Key themes include evolving learner needs, the search for connection, becoming an able e-participant, valued interactions, social construction of content, integration of delivery partners, and mindful weighing of benefits and trade-offs. By sharing insights into what is needed to design and deliver an e-Learning experience, our findings add to the growing knowledge of online learning. Using this model to evaluate perceptions of quality by key stakeholders has led to insights and recommendations on the Demand Driven Learning Model itself which may be useful for researchers in this area and strengthen the model. Quality has been defined in terms of the design of the e-Learning experience, the contextualized experience of learners, and evidence of learning outcomes (Carr and Carr, 2000; Jung 2000; Salmon, 2000). Quality and design of e-Learning courses, however, are sometimes compromised in an “ . . . effort to simply get something up and running” in response to pressing consumer demands (Dick, 1996, p. 59). Educators and researchers have voiced concern over the lack of rigorous evaluation studies of e-Learning programs (e.g., Arbaugh, 2000; Howell, Saba, Lindsay, and Williams, 2004; Lockyer, Patterson, and Harper, 1999; Robinson, 2001). McGorry (2003) adds, “although the number of courses being delivered via the Internet is increasing rapidly, our knowledge of what makes these courses effective learning experiences is limited” (p. 160). In an economic environment marked by intensive competition between educational institutions, producing and ensuring quality e-Learning programs will be a competitive advantage to attract learners to post secondary institutions (Daniel, 1996; Duderstadt, 1999). In this study we used a credible model, the Demand-Driven Learning Model (DDLM), (MacDonald, Stodel, Farres, Breithaupt, and Gabriel, 2001) and its companion evaluation tool (MacDonald, Breithaupt, Stodel, Farres, and Gabriel, 2002) to design and evaluate an online course. Several data collection methods were used to understand the experiences of key stakeholders in this case study: learners, design team, and facilitators. In addition to adding to the growing knowledge of online learning, our findings highlight additional elements that could be incorporated into the DDLM to further refine the model.

[1]  Ron Oliver,et al.  Maximising the language and learning link in computer learning environments , 1998, Br. J. Educ. Technol..

[2]  M. C. O'Connor,et al.  Can We Trace the "Efficacy of Social Constructivism"? , 1998 .

[3]  S. Alexander E‐learning developments and experiences , 2001 .

[4]  Travis Reindl Digital Diploma Mills: The Automation of Higher Education , 2002 .

[5]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[6]  Robert Sommer,et al.  Experience and Education. , 1974 .

[7]  S. Mann A personal inquiry into an experience of adult learning online , 2004 .

[8]  J. Creswell Qualitative inquiry and research design: choosing among five traditions. , 1998 .

[9]  Dianne Conrad,et al.  Engagement, Excitement, Anxiety, and Fear: Learners' Experiences of Starting an Online Course , 2002 .

[10]  Alfred P. Rovai,et al.  A practical framework for evaluating online distance education programs , 2003, Internet High. Educ..

[11]  Janet Macdonald,et al.  Assessing online collaborative learning: process and product , 2003, Comput. Educ..

[12]  John S. Daniel,et al.  The mega-universities and knowledge media : technology strategies for higher education , 1996 .

[13]  D. Jonassen Thinking Technology: Toward a Constructivist Design Model , 1994 .

[14]  Jerry Willis,et al.  The Maturing of Constructivist Instructional Design: Some Basic Principles That Can Guide Practice. , 2000 .

[15]  Fred Lockwood,et al.  Innovation in Open & Distance Learning: Successful Development of Online and Web-Based Learning. , 2001 .

[16]  Philippa Levy,et al.  A methodological framework for practice-based research in networked learning , 2003 .

[17]  B. Speck The Academy, Online Classes, and the Breach in Ethics , 2000 .

[18]  Harry F. Wolcott,et al.  Writing Up Qualitative Research , 1990 .

[19]  Kathy Charmaz,et al.  The Myth of Silent Authorship: Self, Substance, and Style in Ethnographic Writing , 1996 .

[20]  B. Nasseh,et al.  Technical and Pedagogical Challenges Faced by Faculty and Students in Computer-Based Distance Education in Higher Education in Indiana , 1999 .

[21]  Barry Harper,et al.  Measuring Effectiveness of Health Education in a Web-Based Learning Environment: A Preliminary Report , 1999 .

[22]  R. Stake The art of case study research , 1995 .

[23]  Steven Furnell,et al.  The Promise of Online Distance Learning: Addressing Academic and Institutional Concerns. , 2000 .

[24]  Sharan B. Merriam,et al.  Qualitative research and case study applications in education , 1998 .

[25]  D. Jonassen Objectivism versus constructivism: Do we need a new philosophical paradigm? , 1991 .

[26]  Emma J. Stodel,et al.  The demand-driven learning model: A framework for Web-based learning , 2001, Internet High. Educ..

[27]  Melanie Misanchuk,et al.  Adapting a Master's Degree Course to the Web: A Case Analysis. , 2001 .

[28]  D. C. Phillips The Good, the Bad, and the Ugly: The Many Faces of Constructivism , 1995 .

[29]  Daniel V. Eastmond E-Moderating: The Key to Teaching and Learning Online , 2003 .

[30]  T. Fenwick Expanding Conceptions of Experiential Learning: A Review of the Five Contemporary Perspectives on Cognition , 2000 .

[31]  B. Funke,et al.  University Faculty and Student Perceptions of Web-Based Instruction , 1998 .

[32]  Rena M. Palloff,et al.  Lessons from the Cyberspace Classroom: The Realities of Online Teaching , 2001 .

[33]  Richard N. Katz,et al.  Dancing with the Devil: Information Technology and the New Competition in Higher Education. Jossey-Bass Higher and Adult Education Series. , 1998 .

[34]  Janette R. Hill,et al.  Improving online learning: Student perceptions of useful and challenging characteristics , 2004, Internet High. Educ..

[35]  W. Dick The dick and carey model: Will it survive the decade? , 1996 .

[36]  D. Hindman The Virtual Community: Homesteading on the Electronic Frontier , 1996 .

[37]  Michael Hammond,et al.  Communication within on-line forums: the opportunities, the constraints and the value of a communicative approach , 2000, Comput. Educ..

[38]  J. Arbaugh Virtual Classroom Characteristics and Student Satisfaction with Internet-Based MBA Courses , 2000 .

[39]  Terrie Lynn Thompson Even a virtual synchronous classroom has walls: There's more to collective meaning making than the technology , 2003 .

[40]  N. Denzin,et al.  The discipline and practice of qualitative research [Introduction]. Denzin & Y. S. Lincoln (Eds.), The handbook of qualitative research (2nd ed. , 2000 .

[41]  Chad S. Carr,et al.  Instructional Design in Distance Education (IDDE): A Web-based Performance Support System for Educators and Designers. , 2000 .

[42]  B. Bowers Transforming Qualitative Data: Description, Analysis, and Interpretation , 1995 .

[43]  Emma J. Stodel,et al.  Evaluation of Web-Based Educational Programs Via the Demand-Driven Learning Model: A Measure of Web-Based Learning , 2002 .

[44]  R. W. Carstens,et al.  Epilogue: A Cautionary Note About Online Classrooms , 2000 .

[45]  D. Hung,et al.  Situated Cognition, Vygotskian Thought and Learning from the Communities of Practice Perspective: Implications for the Design of Web-Based E-Learning , 2001 .

[46]  N. Denzin,et al.  The Discipline and Practice of Qualitative Research , 2005 .

[47]  Badrul H. Khan,et al.  A framework for web-based learning , 2000 .

[48]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[49]  Stan Guidera,et al.  Adapting Asynchronous Communication to Meet the Seven Principles of Effective Teaching , 2000 .

[50]  Charles A. Schwartz,et al.  Mega-universities and knowledge media: Technology strategies for higher education , 1999 .

[51]  Addressing the spiritual dimensions of adult learning : what educators can do , 2000 .

[52]  Selma Vonderwell,et al.  An examination of asynchronous communication experiences and perspectives of students in an online course: a case study , 2003, Internet High. Educ..

[53]  Insung Jung,et al.  Technology Innovations and the Development of Distance Education: Korean experience , 2000 .

[54]  Susan Y McGorry,et al.  Measuring quality in online programs , 2003, Internet High. Educ..

[55]  A. Benson Dimensions of Quality in Online Degree Programs , 2003 .

[56]  Scott L. Howell,et al.  Seven strategies for enabling faculty success in distance education , 2004, Internet High. Educ..