A Usability Evaluation of a Blended MOOC Environment: An Experimental Case Study.

In the past few years, there has been an increasing interest in Massive Open Online Courses (MOOCs) as a new form of Technology-Enhanced Learning (TEL), in higher education and beyond. Recognizing the limitations of standalone MOOCs, blended MOOCs (bMOOCs) that aim at bringing in-class (i.e. face-to-face) interactions and online learning components together have emerged as an alternative MOOC model of teaching and learning in a higher education context. In this paper, we present the design, implementation, and evaluation details of a bMOOC course on “Teaching Methodologies” at Fayoum University, Egypt in cooperation with RWTH Aachen University, Germany, provided using the bMOOC platform L2P-bMOOC. In order to gauge the usability and effectiveness of the course, we employed an evaluation approach based on Conole’s 12 dimensions rubrics, ISONORM 9241/110-S as a general usability evaluation, and a custom effectiveness questionnaire reflecting the different MOOC stakeholder perspectives.

[1]  Mohamed Amine Chatti.  Personalization in technology enhanced learning: a social software perspective , 2010 .

[2]  Antonio Fini,et al.  The Technological Dimension of a Massive Open Online Course: The Case of the CCK08 Course Tools , 2009 .

[3]  Devayani Tirthali,et al.  MOOCs: Expectations and Reality. Full Report. , 2014 .

[4]  Jochen Prümper,et al.  Der Benutzungsfragebogen ISONORM 9241/10: Ergebnisse zur Reliabilität und Validität , 1997, Software-Ergonomie.

[5]  Christoph Meinel,et al.  Designing MOOCs for the Support of Multiple Learning Styles , 2013, EC-TEL.

[6]  Fiona M. Hollands and Devayani Tirthali.  MOOCs: Expectations and Reality , 2014 .

[7]  Ulrik Schroeder,et al.  Video-Based Learning: A Critical Analysis of The Research Published in 2003-2013 and Future Visions , 2014 .

[8]  Gráinne Conole,et al.  MOOCs as disruptive technologies: strategies for enhancing the learner experience and quality of MOOCs Los MOOC como tecnologías disruptivas: estrategias para mejorar la experiencia de aprendizaje y la calidad de los MOOC. , 2016 .

[9]  Helene Fournier,et al.  A pedagogy of abundance or a pedagogy to support human beings? Participant support on massive open online courses , 2011 .

[10]  Shirley Williams,et al.  MOOCs: A systematic study of the published literature 2008-2012 , 2013 .

[11]  George Siemens,et al.  Courses : Innovation in Education ? , 2013 .

[12]  Yi-Shun Wang,et al.  Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications , 2008, Comput. Educ..

[13]  George Siemens,et al.  The MOOC model for digital practice , 2010 .

[14]  Gayle S. Christensen,et al.  The MOOC Phenomenon: Who Takes Massive Open Online Courses and Why? , 2013 .

[15]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[16]  Douglas H. Fisher,et al.  Wrapping a MOOC: Student Perceptions of an Experiment in Blended Learning , 2013 .

[17]  Kenneth Tobin,et al.  Qualitative Perceptions of Learning Environments on the World Wide Web , 1998 .

[18]  Ulrik Schroeder,et al.  Learning Analytics: Challenges and Future Research Directions , 2014 .

[19]  M. Deimann,et al.  On the role of openness in education: A historical reconstruction , 2013, Distances et médiations des savoirs.

[20]  Nathaniel Ostashewski,et al.  Delivering a MOOC using a social networking site: The SMOOC design model , 2012 .

[21]  J. Daniel,et al.  Making Sense of MOOCs : Musings in a Maze of Myth , Paradox and Possibility Author : , 2013 .

[22]  Rolf Schulmeister.  The Position of xMOOCs in Educational Systems , 2014 .

[23]  Matthias Jarke,et al.  LaaN: Convergence of Knowledge Management and Technology-Enhanced Learning , 2012, IEEE Transactions on Learning Technologies.

[24]  Allison Littlejohn,et al.  Supporting Professional Learning in a Massive Open Online Course. , 2014 .

[25]  Ulrik Schroeder,et al.  A Cluster Analysis of MOOC Stakeholder Perspectives , 2015, International Journal of Educational Technology in Higher Education.

[26]  Ulrik Schroeder,et al.  MOOCs - A Review of the State-of-the-Art , 2014, CSEDU.

[27]  Ulrik Schroeder,et al.  What Drives a Successful MOOC? An Empirical Examination of Criteria to Assure Design Quality of MOOCs , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[28]  Roy Williams,et al.  The Ideals and Reality of Participating in a MOOC , 2010, Proceedings of the International Conference on Networked Learning.