Design Matters: Development and Validation of the Online Course Design Elements (OCDE) Instrument

Course design is critical to online student engagement and retention. This study focused on the development and validation of an online course design elements (OCDE) instrument with 38 Likert-type scale items in five subscales: (a) overview, (b) content presentation, (c) interaction and communication, (d) assessment and evaluation, and (e) learner support. The validation process included implementation with 222 online instructors and instructional designers in higher education. Three models were evaluated which included a one-factor model, five-factor model, and higher-order model. The five-factor and higher-order models aligned with the development of the OCDE. The frequency of use of OCDE items was rated above the mean 4.0 except for two items on collaboration and self-assessment. The overall OCDE score was related to self-reported levels of expertise but not with years of experience. The findings have implications for the use of this instrument with online instructors and instructional designers in the design of online courses.

[1]  D. Bolliger,et al.  Engagement Matters: Student Perceptions on the Importance of Engagement Strategies in the Online Learning Environment. , 2018 .

[2]  Yu-Hui Ching,et al.  Online Course Design in Higher Education: A Review of National and Statewide Evaluation Instruments , 2018 .

[3]  Chad J. McGuire,et al.  An Analysis of Student Self-Assessment of Online, Blended, and Face-to-Face Learning Environments: Implications for Sustainable Education Delivery , 2010 .

[4]  Jo Lita Shackelford,et al.  Sense of Community in Graduate Online Education: Contribution of Learner to Learner Interaction , 2012 .

[5]  Florence Martin,et al.  Student perception of helpfulness of facilitation strategies that enhance instructor presence, connectedness, engagement and learning in online courses , 2018, Internet High. Educ..

[6]  C. Maistre What is an expert instructional designer? Evidence of expert performance during formative evaluation , 1998 .

[7]  Marjorie Vai,et al.  Essentials of Online Course Design: A Standards-Based Guide , 2011 .

[8]  Ray S. Perez,et al.  Instructional design expertise: A cognitive model of design , 1995 .

[9]  Tzu-Chien Liu,et al.  Analysis of learners' navigational behaviour and their learning styles in an online course , 2010, J. Comput. Assist. Learn..

[10]  Brent Muirhead,et al.  E-tivities: The key to active online learning , 2002, J. Educ. Technol. Soc..

[11]  Di Xu,et al.  How do online course design features influence student performance? , 2016, Comput. Educ..

[12]  Joachim K. Rennstich Creative online collaboration: A special challenge for co-creation , 2019, Education and Information Technologies.

[13]  Dannelle D. Stevens,et al.  Introduction to Rubrics: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning , 2004 .

[14]  Beth Dietz-Uhler,et al.  Designing Online Courses to Promote Student Retention , 2007 .

[15]  Mingli Zhang,et al.  Effects of different interactions on students' sense of community in e-learning environment , 2017, Comput. Educ..

[16]  W. Dick The dick and carey model: Will it survive the decade? , 1996 .

[17]  Curtis J. Bonk,et al.  DOES SENSE OF COMMUNITY MATTER? an Examination of Participants' Perceptions of Building Learning Communities in Online Courses , 2007 .

[18]  Insook Han,et al.  The use of a mobile learning management system and academic achievement of online students , 2016, Comput. Educ..

[19]  Albert D. Ritzhaupt,et al.  Award-winning faculty online teaching practices: Course design, assessment and evaluation, and facilitation , 2019, Internet High. Educ..

[20]  Rodney O. Rogers,et al.  The Importance of Policies in E-Learning Instruction , 2004 .

[21]  Eugene W. Lyman,et al.  An Instructional Design Framework for Fostering Student Engagement in Online Learning Environments , 2016 .

[22]  Kona Renee Jones,et al.  DEVELOPING AND IMPLEMENTING A MANDATORY ONLINE STUDENT ORIENTATION , 2013 .

[23]  R. Kline Principles and practice of structural equation modeling, 4th ed. , 2016 .

[24]  D. Keegan,et al.  Three Types of Interaction , 2013 .

[25]  Beryl C. McEwen,et al.  Effective Online Instructional and Assessment Strategies , 2007 .

[26]  R. Little A Test of Missing Completely at Random for Multivariate Data with Missing Values , 1988 .

[27]  Brock Craft,et al.  A constructionist learning environment for teachers to model learning designs , 2013, J. Comput. Assist. Learn..

[28]  Suzanne Young,et al.  Student Views of Effective Online Teaching in Higher Education , 2006 .

[29]  Cheng-Hsien Li Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares , 2016, Behavior research methods.

[30]  Cindy Ann Dell,et al.  Applying Universal Design for Learning in Online Courses: Pedagogical and Practical Considerations. , 2015 .

[31]  Cecilia Jane Maier,et al.  Improving Online Teaching by Using Established Best Classroom Teaching Practices. , 2016, Journal of continuing education in nursing.

[32]  Florence Martin,et al.  Award-winning faculty online teaching practices: Elements of award-winning courses , 2019 .

[33]  Susan Ko,et al.  Teaching Online: A Practical Guide , 2000 .

[34]  M. Romero,et al.  Are online learners frustrated with collaborative learning experiences , 2012 .

[35]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[36]  Sue-Jen Chen,et al.  Instructional Design Strategies for Intensive Online Courses: An Objectivist-Constructivist Blended Approach. , 2007 .

[37]  J. Shanteau Competence in experts: The role of task characteristics , 1992 .

[38]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[39]  Magdalena Mateescu,et al.  Mobile and ubiquitous learning in higher education settings. A systematic review of empirical studies , 2016, Comput. Hum. Behav..

[40]  Hussein Suleman,et al.  Designing mobile LMS interfaces: learners' expectations and experiences , 2013, Interact. Technol. Smart Educ..

[41]  Karen Swan,et al.  Virtual interaction: Design factors affecting student satisfaction and perceived learning in asynchronous online courses , 2001 .