Students' Learning Outcomes in Massive Open Online Courses (MOOCs): Some Suggestions for Course Design

M assive Open Online Courses (MOOC) are built on the impression that “information is everywhere” by extending access to education. A MOOC is a course, but it is open, distributed, participatory, and part of lifelong network learning. The underlying idea of a MOOC is accessibility, since anyone can participate by working collaboratively either to acquire new knowledge or to expand existing knowledge. This implies that MOOCs create a pathway for lifelong learning processes. MOOCs are online classes in which anyone can participate, regardless of location, in most cases for free. They are comprised of short video lectures, simulations, and online labs combined with computer-graded tests and online forums where participants can discuss the course content or get help (Hoy, 2014). Basically, MOOCs are a form of online learning that share some common features: open access using the Internet, free of charge, asynchronous, interactive user forums, and the opportunity to receive a certificate upon successful completion (EDUCAUSE, 2011). Student Üçüncü nesil uzaktan e¤itim kapsam›nda kitlesel aç›k eriflim çevrimiçi dersler (massive open online courses, MOOC’lar) sayesinde yüksek ö¤renimde herkes istedi¤i yerden ücretsiz e¤itim alabilmektedir. Son y›llarda, e¤itimde MOOC’lar›n yeri üzerine birçok çal›flma yap›lm›flt›r, ancak ö¤rencilerin kazan›mlar› üzerine olan çal›flmalar s›n›rl›d›r. Bu çal›flmada, aç›k eriflim çevrimiçi derslerin tasarlanmas›na yönelik birtak›m önerileri belirlemek amac›yla, ö¤rencilerin MOOC’lardaki kazan›mlar›na iliflkin literatürü gözden geçirildi. ‹nceleme, bilimsel literatür veritabanlar›n›n sistematik olarak araflt›r›lmas›n›n ard›ndan, 3P (presage [öngörü], process [süreç] ve product [ürün]) ö¤retim ve ö¤renim modelinin temel bileflenlerine yönelik elefltirel bir analizle gerçeklefltirildi (Biggs, 2003). 56 yay›n›n bulgular› sentezlenerek, ö¤rencilerin kat›l›m›n› ve akademik baflar›y› gelifltirmek ve terk etme oranlar›n› düflürmek amac›yla 13 ders tasar›m› önerisi gelifltirildi. Gerek ileriki araflt›rmalarda incelenmek üzere gerek ise de MOOC’lar›n mevcut içeri¤ini gelifltirerek ve zenginlefltirerek ö¤renim kazan›mlar›n› en iyi hale getirmek için baz› uygulama önerileri sunuldu.

[1]  Dong Liang,et al.  Analysis of learners’ behaviors and learning outcomes in a massive open online course , 2014 .

[2]  Patrick Griffin,et al.  A new approach towards marking large-scale complex assessments: Developing a distributed marking system that uses an automatically scaffolding and rubric-targeted interface for guided peer-review , 2015 .

[3]  N. Stefanic.  Creativity-Based Music Learning: Modeling the Process and Learning Outcomes in a Massive Open Online Course , 2014 .

[4]  Andrew D. Ho,et al.  Changing “Course” , 2014 .

[5]  Douglas H. Fisher.  Leveraging AI Teaching in the Cloud for AI Teaching on Campus , 2014, AI Mag..

[6]  Tharindu Rekha Liyanagunawardena,et al.  Massive Open Online Courses , 2015 .

[7]  Katy Jordan,et al.  Massive Open Online Course Completion Rates Revisited: Assessment, Length and Attrition , 2015 .

[8]  Norliza Katuk,et al.  Experience beyond knowledge: Pragmatic e-learning systems design with learning experience , 2013, Comput. Hum. Behav..

[9]  Stephen P. Balfour,et al.  Assessing Writing in MOOCs: Automated Essay Scoring and Calibrated Peer Review™. , 2013 .

[10]  Eva Schiorring,et al.  Case study: using MOOCs for conventional college coursework , 2014 .

[11]  Matthew B Hoy.  MOOCs 101: An Introduction to Massive Open Online Courses , 2014, Medical reference services quarterly.

[12]  Guillaume Durand,et al.  Challenges to Research in MOOCs , 2014 .

[13]  Jae Hoon Han,et al.  Closing the Missing Links and Opening the Relationships among the Factors: A Literature Review on the Use of Clicker Technology Using the 3P Model , 2014, J. Educ. Technol. Soc..

[14]  Omid Noroozi,et al.  Argumentation-Based Computer Supported Collaborative Learning (ABCSCL): A Synthesis of 15 Years of Research. , 2012 .

[15]  Wilfried Admiraal,et al.  Assessment in Massive Open Online Courses , 2015 .

[16]  Mark Warschauer,et al.  Influence of Incentives on Performance in a Pre-College Biology MOOC. , 2014 .

[17]  K. Hew,et al.  Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges , 2014 .

[18]  Min Liu,et al.  Understanding MOOCs as an Emerging Online Learning Tool: Perspectives From the Students , 2013 .

[19]  George Veletsianos,et al.  Digging deeper into learners' experiences in MOOCs: Participation in social networks outside of MOOCs, notetaking and contexts surrounding content consumption , 2015, Br. J. Educ. Technol..

[20]  Sarah A. Webster,et al.  Learner Participation and Engagement in Open Online Courses: Insights from the Peer 2 Peer University , 2013 .

[21]  Elena Barberà,et al.  Three problems with the connectivist conception of learning , 2014, J. Comput. Assist. Learn..

[22]  Celia Popovic,et al.  Teaching for quality learning at university. (2nd Edn.) , 2013 .

[23]  Myint Swe Khine,et al.  Blended learning approach in teacher education: combining face-to-face instruction, multimedia viewing and online discussion , 2003, Br. J. Educ. Technol..

[24]  Stephanie D. Teasley,et al.  Democratizing Higher Education: Exploring MOOC Use Among Those Who Cannot Afford a Formal Education , 2014 .

[25]  Jen Ross,et al.  The pedagogy of the Massive Open Online Course (MOOC): the UK view , 2014 .

[26]  E. Xing,et al.  Towards an Integration of Text and Graph Clustering Methods as a Lens for Studying Social Interaction in MOOCs , 2014 .

[27]  Frances Bell,et al.  Rhizo14: A Rhizomatic Learning cMOOC in Sunlight and in Shade. , 2015 .

[28]  Anne Trumbore,et al.  Rules of Engagement: Strategies to Increase Online Engagement at Scale , 2014 .

[29]  D. Glance,et al.  Flipping the sociology classroom: Towards a practice of online pedagogy , 2013 .

[30]  Justin Reich,et al.  Rebooting MOOC Research , 2015, Science.

[31]  Helene Fournier,et al.  A pedagogy of abundance or a pedagogy to support human beings? Participant support on massive open online courses , 2011 .

[32]  Pin-Ju Chen,et al.  MOOC study group: Facilitation strategies, influential factors, and student perceived gains , 2015, Comput. Educ..

[33]  Curtis J. Bonk,et al.  Understanding the Self-Directed Online Learning Preferences, Goals, Achievements, and Challenges of MIT OpenCourseWare Subscribers , 2015, J. Educ. Technol. Soc..

[34]  Jeff Haywood,et al.  Emerging patterns in MOOCs: Learners, course designs and directions , 2015 .

[35]  Mushtak Al-Atabi,et al.  Teaching entrepreneurship using Massive Open Online Course (MOOC) , 2014 .

[36]  Michail N. Giannakos,et al.  Looking at MOOCs Rapid Growth Through the Lens of Video-Based Learning Research , 2014, iJET.

[37]  Martin Ebner,et al.  “How satisfied are you with your MOOC?” - A Research Study on Interaction in Huge Online Courses , 2013 .

[38]  Rebecca Eynon,et al.  Communication patterns in massively open online courses , 2014, Internet High. Educ..

[39]  Allison Littlejohn,et al.  Instructional quality of Massive Open Online Courses (MOOCs) , 2015, Comput. Educ..

[40]  Guillaume Zufferey,et al.  Watching MOOCs together: investigating co-located MOOC study groups , 2014 .

[41]  John Morgan,et al.  Will MOOCs transform learning and teaching in higher education? Engagement and course retention in online learning provision , 2015, Br. J. Educ. Technol..

[42]  Carolyn Penstein Rosé,et al.  Identifying Latent Study Habits by Mining Learner Behavior Patterns in Massive Open Online Courses , 2014, CIKM.

[43]  Mia Zamora,et al.  What makes a cMOOC community endure? Multiple participant perspectives from diverse cMOOCs , 2015 .

[44]  Kyle M. Williams,et al.  Evaluating the Validity and Applicability of Automated Essay Scoring in Two Massive Open Online Courses , 2014 .

[45]  Hedieh Najafi,et al.  A Comparison of Learner Intent and Behaviour in Live and Archived MOOCs. , 2014 .

[46]  Kristiina Kumpulainen,et al.  Participants' Perceptions of Learning and Networking in Connectivist MOOCs , 2014 .

[47]  Maureen Ebben,et al.  Unpacking MOOC scholarly discourse: a review of nascent MOOC scholarship , 2014 .

[48]  Robert F. Boruch,et al.  Moving Through MOOCs , 2014 .

[49]  Samar Zutshi,et al.  Experiences in MOOCs: The Perspective of Students , 2013 .

[50]  Li Yuan and Stephen Powell and Bill Olivier,et al.  Beyond MOOCs: Sustainable Online Learning in Institutions , 2014 .

[51]  Tharindu Rekha Liyanagunawardena,et al.  Who are with us: MOOC learners on a FutureLearn course , 2015, Br. J. Educ. Technol..

[52]  K. Steffens.  Competences, Learning Theories and MOOCs: Recent Developments in Lifelong Learning. , 2015 .

[53]  C. Osvaldo Rodriguez,et al.  MOOCs and the AI-Stanford Like Courses: Two Successful and Distinct Course Formats for Massive Open Online Courses. , 2012 .

[54]  Blanka Klimova,et al.  IMPACT OF A FORM OF ONLINE MATERIALS ON THE QUALITY OF EDUCATION – A CASE STUDY , 2013 .

[55]  Vanesa Daza,et al.  MOOC attack: closing the gap between pre-university and university mathematics , 2013 .

[56]  Candace Thille,et al.  The Future of Data-Enriched Assessment. , 2014 .

[57]  Justin Cheng,et al.  Peer and self assessment in massive online classes , 2013, ACM Trans. Comput. Hum. Interact..

[58]  Christina Wasson.  “It was like a little community”: An ethnographic study of online learning and its implications for MOOCs , 2013 .

[59]  Justin Reich,et al.  HarvardX and MITx: The First Year of Open Online Courses, Fall 2012-Summer 2013 , 2014 .

[60]  Yoav Bergner,et al.  Who does what in a massive open online course? , 2014, Commun. ACM.

[61]  Erika-Elvira Hernández-Carranza,et al.  Evaluation of Digital Didactic Skills in Massive Open Online Courses: a Contribution to the , 2015 .

[62]  Paul Diver,et al.  MOOCs as a massive research laboratory: opportunities and challenges , 2015 .

[63]  J. Greene,et al.  Predictors of Retention and Achievement in a Massive Open Online Course , 2015 .

[64]  Inmaculada Maiz Olazabalaga,et al.  Design, Motivation and Performance in a Cooperative MOOC Course , 2015 .

[65]  Ray-I Chang,et al.  Survey of learning experiences and influence of learning style preferences on user intentions regarding MOOCs , 2015, Br. J. Educ. Technol..

[66]  J. Michael Spector,et al.  Remarks on MOOCS and Mini-MOOCS , 2014, Educational Technology Research and Development.

[67]  Gerhard Fischer,et al.  Beyond hype and underestimation: identifying research challenges for the future of MOOCs , 2014 .

[68]  Marion Waite,et al.  Learning in a Small, Task-Oriented, Connectivist MOOC: Pedagogical Issues and Implications for Higher Education. , 2013 .

[69]  Ulrik Schroeder,et al.  A Cluster Analysis of MOOC Stakeholder Perspectives , 2015, International Journal of Educational Technology in Higher Education.

[70]  Katy Jordan,et al.  Initial trends in enrolment and completion of massive open online courses , 2014 .

[71]  Wilfried Admiraal,et al.  Self- and Peer Assessment in Massive Open Online Courses , 2014 .

[72]  Shirley Williams,et al.  MOOCs: A systematic study of the published literature 2008-2012 , 2013 .

[73]  Joseph A. Konstan,et al.  Teaching Recommender Systems at Large Scale , 2015, ACM Trans. Comput. Hum. Interact..

[74]  R. Redfield,et al.  Putting my money where my mouth is: the Useful Genetics project. , 2015, Trends in genetics : TIG.

[75]  David George Glance,et al.  The pedagogical foundations of massive open online courses , 2013, First Monday.

[76]  René F. Kizilcec,et al.  The instructor’s face in video instruction: Evidence from two large-scale field studies. , 2015, Journal of Educational Psychology.

[77]  Yin Yin,et al.  A phenomenology of learning large: the tutorial sphere of xMOOC video lectures , 2014 .

[78]  Panagiotis Zaharias,et al.  Down the Rabbit Hole: An initial typology of issues around the development of MOOCs , 2015 .

[79]  Allison Littlejohn,et al.  Supporting Professional Learning in a Massive Open Online Course. , 2014 .

[80]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[81]  Rebecca Vivian,et al.  Addressing the challenges of a new digital technologies curriculum: MOOCs as a scalable solution for teacher professional development , 2014 .

[82]  H. Biemans,et al.  Teaching and Learning in Interdisciplinary Higher Education: A Systematic Review , 2009 .

[83]  Antonio Fini,et al.  The Technological Dimension of a Massive Open Online Course: The Case of the CCK08 Course Tools , 2009 .

[84]  René F. Kizilcec,et al.  Motivation as a Lens to Understand Online Learners , 2015, ACM Trans. Comput. Hum. Interact..

[85]  Brit Toven-Lindsey,et al.  Virtually unlimited classrooms: Pedagogical practices in massive open online courses , 2015, Internet High. Educ..

[86]  Sandra L. Miller,et al.  Teaching an Online Pedagogy MOOC , 2015 .

[87]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[88]  Dorian A. Canelas,et al.  Writing to learn and learning to write across the disciplines: Peer-to-peer writing in introductory-level MOOCs , 2014 .

[89]  George Siemens,et al.  Where is research on massive open online courses headed? A data analysis of the MOOC research initiative , 2014 .

[90]  Rukshan Athauda,et al.  Boosting the Opportunities of Open Learning (MOOCs) through Learning Theories , 2013 .

[91]  Rita Kop,et al.  The Challenges to Connectivist Learning on Open Online Networks: Learning Experiences during a Massive Open Online Course , 2011 .

[92]  Allison Littlejohn,et al.  Merlot Journal of Online Learning and Teaching Patterns of Engagement in Connectivist Moocs , 2022 .