From Seminar to Lecture to MOOC: Scripting and Orchestration at Scale

This dissertation investigates the design of large online courses from the pedagogical perspective of knowledge communities. Much of the learning sciences literature has concerned itself with groups of up to 20-30 students, but in universities, courses of several hundred to more than a thousand students are common. At the same time, new models for life-long and informal learning, such as Massive Open Online Courses, are emerging. Amidst this growing enthusiasm for innovation around technology and design in teaching, there is a need for theoretically grounded innovations and rigorous research around practical models that support new approaches to learning. One recent model, known as Knowledge Community and Inquiry (KCI), engages students in the co-construction of a community knowledge base, with a commonly held understanding of the collective nature of their learning, and then provides a sequence of scaffolded inquiry activities where students make use of the knowledge base as a resource. Inspired by this approach to designing courses, the research began with a redesign of an in-service teacher education course, which increased in size from 25 to 75 students. This redesign was carefully analyzed, and design principles extracted. The second step was the design of a Massive Open Online Course for several thousand in-service teachers on technology and inquiry, in collaboration with an affiliated secondary school. A number of innovative design ideas were necessary to accommodate the large number of users, the much larger diversity in terms of background, interest, and engagement among MOOC learners, and the opportunities provided by the platform. The resulting design encompasses a 6- week long curriculum script, and a number of overlapping micro-scripts supported by a custom- written platform that integrated with the EdX platform in a seamless manner. This thesis presents the course structure, including connection to disciplinary principles, its affordances for community and collaboration and its support of individual differentiated learning and collective epistemology. It offers design principles for scripting and orchestrating collective inquiry designs for MOOCS and higher education courses.

[1]  John Y. Baek,et al.  Handbook Of Design Research Methods In Education: Innovations In Science, Technology, Engineering, And Mathematics Learning And Teaching , 2018 .

[2]  Yu-Jin Kim,et al.  Students' Visual Perceptions of Virtual Lectures as Measured by Eye Tracking , 2009, HCI.

[3]  H. Mandl,et al.  Communities of practice toward expertise: Social foundation of university instruction , 1996 .

[4]  A. Bandura Social Foundations of Thought and Action , 1986 .

[5]  Jan van Aalst,et al.  Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses , 2009, Int. J. Comput. Support. Collab. Learn..

[6]  Justin Reich,et al.  Rebooting MOOC Research , 2015, Science.

[7]  George Siemens,et al.  The MOOC model for digital practice , 2010 .

[8]  Anne Balsamo,et al.  An Idea Whose Time is Here: FemTechNet – A Distributed Online Collaborative Course (DOCC) , 2012 .

[9]  Jan van den Akker,et al.  Principles and Methods of Development Research , 1999 .

[10]  Pierre Dillenbourg,et al.  Over-scripting CSCL: The risks of blending collaborative learning with instructional design , 2002 .

[11]  Carolyn Penstein Rosé,et al.  Positive Impact of Collaborative Chat Participation in an edX MOOC , 2015, AIED.

[12]  Jo Ann Oravec Blending by Blogging: weblogs in blended learning initiatives , 2003 .

[13]  Stavros N. Demetriadis,et al.  The Impact of Script Coercion in Computer-Supported Collaboration: A Case Study on Learning Benefits When Technology Makes Learners' Thinking Processes Explicit , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[14]  Patrick Jermann,et al.  Collaborative Gaze Footprints: Correlates of Interaction Quality , 2011, CSCL.

[15]  Miriam Gamoran Sherin,et al.  Fostering communities of teachers as learners: disciplinary perspectives , 2004 .

[16]  Annemarie S. Palincsar,et al.  Social constructivist perspectives on teaching and learning. , 1998, Annual review of psychology.

[17]  Vic Lally,et al.  Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for Social Network Analysis , 2007, Int. J. Comput. Support. Collab. Learn..

[18]  B. Zimmerman,et al.  Self-Efficacy: An Essential Motive to Learn. , 2000, Contemporary educational psychology.

[19]  Yannis A. Dimitriadis,et al.  The role of design and enactment patterns in orchestration: Helping to integrate technology in blended classroom ecosystems , 2013, Comput. Educ..

[20]  L. D'Amico The Center for Learning Technologies in Urban Schools: A Case of Design-Based Research in Education , 2005 .

[21]  B. Dick,et al.  A practitioner in the academy: An interview with Bob Dick , 2012 .

[22]  S. Chaiklin The zone of proximal development in Vygotsky's analysis of learning and instruction. , 2003 .

[23]  Teemu Leinonen,et al.  Collaborative discovering of key ideas in knowledge building , 2002, CSCL.

[24]  Daniel T. Hickey,et al.  Small to big before massive: scaling up participatory learning analytics , 2014, LAK.

[25]  Joshua D. Quick,et al.  Formative and summative analyses of disciplinary engagement and learning in a big open online course , 2015, LAK.

[26]  George Siemens,et al.  The Open Course: Through the Open Door--Open Courses as Research, Learning, and Engagement , 2010 .

[27]  Jörg M. Haake,et al.  Flexible Scripting in Net-Based Learning Groups , 2007 .

[28]  James D. Foley,et al.  Evaluating a Web Lecture Intervention in a Human–Computer Interaction Course , 2006, IEEE Transactions on Education.

[29]  Raquel M. Crespo García,et al.  Towards Efficient Provision of Feedback Supported by Learning Analytics , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[30]  Michelene T. H. Chi,et al.  The Influence of the Tutee in Learning by Peer Tutoring , 2004 .

[31]  Bodong Chen Visualizing semantic space of online discourse: the knowledge forum case , 2014, LAK '14.

[32]  E. Cohen Restructuring the Classroom: Conditions for Productive Small Groups , 1994 .

[33]  Roy Williams,et al.  The Ideals and Reality of Participating in a MOOC , 2010, Proceedings of the International Conference on Networked Learning.

[34]  Christof Wecker,et al.  Fading scripts in computer-supported collaborative learning: the role of distributed monitoring , 2007, CSCL.

[35]  James D. Slotta,et al.  Orchestrating of complex inquiry: three roles for learning analytics in a smart classroom infrastructure , 2013, LAK '13.

[36]  Bruce M. McLaren,et al.  Supporting Collaborative Learning and E-Discussions Using Artificial Intelligence Techniques , 2010, Int. J. Artif. Intell. Educ..

[37]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[38]  James D. Slotta,et al.  Supporting Collaborative Knowledge Construction with Web 2.0 Technologies , 2013 .

[39]  Carl Bereiter,et al.  Design Research for Sustained Innovation , 2002 .

[40]  Carol K. K. Chan,et al.  Students assessing their own collaborative knowledge building , 2006, Int. J. Comput. Support. Collab. Learn..

[41]  M. Scardamalia,et al.  Socio-cognitive dynamics of knowledge building in the work of 9- and 10-year-olds , 2007 .

[42]  Sarah A. Webster,et al.  Learner Participation and Engagement in Open Online Courses: Insights from the Peer 2 Peer University , 2013 .

[43]  Heinz Mandl,et al.  Knowledge Convergence in Computer-Supported Collaborative Learning: The Role of External Representation Tools , 2005 .

[44]  William A. Sandoval,et al.  Conjecture Mapping: An Approach to Systematic Educational Design Research , 2014 .

[45]  Pierre Dillenbourg,et al.  Design for classroom orchestration , 2013, Comput. Educ..

[46]  Pierre Dillenbourg,et al.  Sleepers' lag - study on motion and attention , 2014, LAK.

[47]  Davinia Hernández Leo,et al.  Web Collage: An implementation of support for assessment design in CSCL macro-scripts , 2013, Comput. Educ..

[48]  Fridolin Wild,et al.  Designing for Change: Mash-Up Personal Learning Environments , 2008 .

[49]  Elise Lavoué,et al.  A Dashboard to Regulate Project-Based Learning , 2012, EC-TEL.

[50]  Cresencia Fong,et al.  Supporting Discourse and Classroom Orchestration in a Knowledge Community and Inquiry Approach , 2014 .

[51]  J. Biggs What do inventories of students' learning processes really measure? A theoretical review and clarification. , 1993, The British journal of educational psychology.

[52]  Frances Bell,et al.  Network theories for technology-enabled learning and social change: Connectivism and actor network theory , 2010 .

[53]  Susan A. Yoon Using Social Network Graphs as Visualization Tools to Influence Peer Selection Decision-Making Strategies to Access Information About Complex Socioscientific Issues , 2011 .

[54]  Helene Fournier,et al.  A pedagogy of abundance or a pedagogy to support human beings? Participant support on massive open online courses , 2011 .

[55]  洪煌堯 Constantly Going Deeper: Knowledge Building Innovation in an Elementary Professional Community , 2008 .

[56]  R. Mayer Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction , 1996 .

[57]  Huang-Yao Hong,et al.  Sustaining Knowledge Building as a Principle-Based Innovation at an Elementary School , 2011 .

[58]  Michelle Mei Yee Lui,et al.  Designing EvoRoom: An Immersive Simulation Environment for Collective Inquiry in Secondary Science , 2015 .

[59]  Pierre Dillenbourg,et al.  The mechanics of CSCL macro scripts , 2008, Int. J. Comput. Support. Collab. Learn..

[60]  Christopher Teplovs Visualization of Knowledge Spaces to Enable Concurrent, Embedded and Transformative Input to Knowledge Building Processes , 2010 .

[61]  Katerine Bielaczyc,et al.  Learning communities in classrooms: A reconceptualization of educational practice , 1999 .

[62]  J. Brown,et al.  Minds on Fire: Open Education, the Long Tail, and Learning 2.0 , 2008 .

[63]  Kenneth R. Koedinger,et al.  Beyond explicit feedback: new directions in adaptive collaborative learning support , 2009, CSCL.

[64]  A. Jonker Origins of the modern mind. Three stages in the evolution of culture and cognition , 1998 .

[65]  Panagiota Alevizou,et al.  Engaging with open education , 2010, Int. Sym. Wikis.

[66]  Ulrike Cress,et al.  Mass Collaboration and Education , 2016 .

[67]  James D. Slotta,et al.  A blended model for knowledge communities: embedding scaffolded inquiry , 2008, ICLS.

[68]  F. Bell Connectivism: Its place in theory-informed research and innovation in technology-enabled learning , 2011 .

[69]  Hyo-Jeong So,et al.  A comparative discourse analysis of online and offline knowledge building activities , 2008, ICLS.

[70]  Mike Tissenbaum,et al.  Supporting Collective Inquiry: A Technology Framework for Distributed Learning , 2014 .

[71]  C. Davidson,et al.  The Future of Learning Institutions in a Digital Age , 2009 .

[72]  James D. Slotta,et al.  Analyzing collaborative knowledge construction in secondary school biology , 2010, ICLS.

[73]  A. Kelly Design Research in Education: Yes, but is it Methodological? , 2004 .

[74]  Abbie Brown,et al.  Design experiments: Theoretical and methodological challenges in creating complex interventions in c , 1992 .

[75]  David H. Jonassen,et al.  Constructivism: Implications for the Design and Delivery of Instruction , 1996 .

[76]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[77]  C. Miller,et al.  Up to the Mark: A Study of the Examination Game. , 1974 .

[78]  Ann L. Brown,et al.  Guided discovery in a community of learners. , 1994 .

[79]  E. Aronson The Jigsaw Classroom , 1978 .

[80]  Michael S. Bernstein,et al.  Talkabout: Making Distance Matter with Small Groups in Massive Classes , 2015, CSCW.

[81]  Carolyn Penstein Rosé,et al.  Architecture for Building Conversational Agents that Support Collaborative Learning , 2011, IEEE Transactions on Learning Technologies.

[82]  Joseph Corneli,et al.  Personalised Peer-Supported Learning: The Peer-to-Peer Learning Environment (P2PLE). , 2011 .

[83]  T. Anderson,et al.  Design-Based Research , 2012 .

[84]  Patrick Jermann,et al.  Designing Integrative Scripts , 2007 .

[85]  Frances Bell,et al.  Rhizo14: A Rhizomatic Learning cMOOC in Sunlight and in Shade. , 2015 .

[86]  George Veletsianos,et al.  Who Studies MOOCs? Interdisciplinarity in MOOC Research and Its Changes over Time. , 2015 .

[87]  Michelene T. H. Chi,et al.  Learning from Examples Via Self-Explanations , 1988, Knowing, Learning, and Instruction.

[88]  Charles R. Graham,et al.  Blended Learning Environments: Definitions and Directions. , 2003 .

[89]  S. Puntambekar,et al.  Comparing Classroom Enactments of an Inquiry Curriculum: Lessons Learned From Two Teachers , 2007 .

[90]  Rita Kop,et al.  The Challenges to Connectivist Learning on Open Online Networks: Learning Experiences during a Massive Open Online Course , 2011 .

[91]  Ann L. Brown,et al.  Reciprocal Teaching of Comprehension-Fostering and Comprehension-Monitoring Activities , 1984 .

[92]  T. S. Hasselbring,et al.  Anchored Instruction: Why We Need It and How Technology Can Help , 2012 .

[93]  Fiona M. Hollands and Devayani Tirthali MOOCs: Expectations and Reality , 2014 .

[94]  Yannis A. Dimitriadis,et al.  Supporting orchestration of CSCL scenarios in web-based Distributed Learning Environments , 2014, Comput. Educ..

[95]  Andreas Harrer,et al.  Bridging the Gap - Towards a Graphical Modeling Language for Learning Designs and Collaboration Scripts of Various Granularities , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[96]  M. Scardamalia,et al.  Knowledge Building: Theory, Pedagogy, and Technology , 2006 .

[97]  F. Fischer,et al.  Collaboration Scripts – A Conceptual Analysis , 2006 .

[98]  Brock Craft,et al.  A constructionist learning environment for teachers to model learning designs , 2013, J. Comput. Assist. Learn..

[99]  Daniel D. Suthers,et al.  CSCL: An historical perspective. , 2006 .

[100]  Daniel T. Hickey,et al.  Wikifolios, reflections, and exams for online engagement, understanding, and achievement , 2012 .

[101]  N. Entwistle,et al.  Approaches to Learning and Levels of , 1979 .

[102]  V. Peters Knowledge community and inquiry in secondary school science , 2010 .

[103]  Christof Wecker,et al.  Fading instructional scripts: preventing relapses into novice strategies by distributed monitoring , 2010, ICLS.

[104]  Päivi Häkkinen,et al.  Instructional support in CSCL , 2004 .

[105]  Marlene Scardamalia,et al.  Engaging Students in a Knowledge Society. , 1996 .

[106]  Marcia C. Linn,et al.  Science Education: Integrating Views of Learning and Instruction , 2006 .

[107]  James D. Slotta,et al.  Analyzing equality of participation in collaborative inquiry: toward a knowledge community , 2010, ICLS.

[108]  Carolyn Penstein Rosé,et al.  Fostering Discussion across Communication Media in Massive Open Online Courses , 2015, CSCL.

[109]  George Siemens Learning and knowing in networks: Changing roles for educators and designers , 2008 .

[110]  Iván M. Jorrín-Abellán,et al.  Reusing IMS LD formalized best practices in collaborative learning structuring , 2005 .

[111]  Gerry Stahl,et al.  Contributions to a theoretical framework for CSCL , 2002, CSCL.

[112]  George Siemens,et al.  Learning analytics: envisioning a research discipline and a domain of practice , 2012, LAK.

[113]  Rita Kop,et al.  Connectivism: Learning theory of the future or vestige of the past? , 2008 .

[114]  Bodong Chen,et al.  Uncovering what matters: analyzing transitional relations among contribution types in knowledge-building discourse , 2014, LAK.

[115]  Mart Laanpere,et al.  Conceptual Design of EduFeedr - an Educationally Enhanced Mash-up Tool for Agora Courses , 2009, MUPPLE@EC-TEL.

[116]  James D. Slotta,et al.  Scaffolding Knowledge Communities in the Classroom: New Opportunities in the Web 2.0 Era , 2010 .

[117]  Pierre Tchounikine Directions to Acknowledge Learners' Self-organization in CSCL Macro-scripts , 2007, CRIWG.

[118]  A. L. Brown Transforming schools into communities of thinking and learning about serious matters. , 1997, The American psychologist.

[119]  Theo Hug,et al.  Media, Knowledge & Education: Exploring new Spaces, Relations and Dynamics in Digital Media Ecologies , 2008 .

[120]  Antonio Fini,et al.  The Technological Dimension of a Massive Open Online Course: The Case of the CCK08 Course Tools , 2009 .

[121]  Dave Cormier,et al.  Rhizomatic Education: Community as Curriculum , 2008 .

[122]  Francesca Pozzi,et al.  Using Jigsaw and Case Study for supporting online collaborative learning , 2010, Comput. Educ..

[123]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[124]  L. Schauble,et al.  Design Experiments in Educational Research , 2003 .

[125]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[126]  Gerardo Ayala Scripting Collaborative Learning in Agent-Based Systems , 2007 .

[127]  M. Scardamalia Collective cognitive responsibility for the advancement of knowledge , 2002 .

[128]  Rodney A. Nason,et al.  Fostering authentic, sustained, and progressive mathematical knowledge-building activity in computer supported collaborative learning (CSCL) communities , 2003 .

[129]  George Siemens Connectivism: A Learning Theory for the Digital Age , 2004 .

[130]  Bronwen Maxson,et al.  An Examination of Coursera as an Information Environment: Does Coursera Fulfill its Mission to Provide Open Education to All? , 2013 .

[131]  Allan Collins,et al.  Design Research: Theoretical and Methodological Issues , 2004 .

[132]  Teemu Leinonen,et al.  Learning in and with an Open Wiki Project: Wikiversity's Potential in Global Capacity Building , 2009, First Monday.

[133]  Allan Collins,et al.  Toward a Design Science of Education , 1992 .

[134]  James D. Slotta,et al.  Toward a Design Framework for International Peer Discussions: Taking Advantage of Disparate Perspectives on Socio-Scientific Issues , 2010, Res. Pract. Technol. Enhanc. Learn..

[135]  W. G. Perry Forms of Intellectual and Ethical Development in the College Years: A Scheme. Jossey-Bass Higher and Adult Education Series. , 1970 .

[136]  Marlene Scardamalia,et al.  A Brief History of Knowledge Building , 2010 .

[137]  Pierre Dillenbourg,et al.  Teaching community health by exploiting international socio-cultural and economical differences. , 2001 .

[138]  F. Fischer,et al.  Toward a Script Theory of Guidance in Computer-Supported Collaborative Learning , 2013, Educational psychologist.

[139]  D. Aspin,et al.  Lifelong learning: concepts and conceptions , 2000 .

[140]  Martin Weller,et al.  Using learning design as a framework for supporting the design and reuse of OER , 2008 .

[141]  David H. Jonassen,et al.  Supporting Communities of Learners with Technology: A Vision for Integrating Technology with Learning in Schools. , 1995 .

[142]  Heinz Mandl,et al.  Facilitating Collaborative Knowledge Construction in Computer-Mediated Learning Environments with Cooperation Scripts , 2005 .

[143]  Pierre Tchounikine,et al.  Operationalizing macro-scripts in CSCL technological settings , 2008, Int. J. Comput. Support. Collab. Learn..

[144]  Judy Kay,et al.  MOOCs: So Many Learners, So Much Potential ... , 2013, IEEE Intelligent Systems.

[145]  Gerald C. Gannod,et al.  Using the inverted classroom to teach software engineering , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[146]  W. Sandoval Developing Learning Theory by Refining Conjectures Embodied in Educational Designs , 2004 .

[147]  R. Benjamin Shapiro,et al.  Toward Participatory Discovery Networks: A Critique of Current Mass Collaboration Environments and a Possible Learning-Rich Future , 2016 .

[148]  Cindy E. Hmelo-Silver,et al.  Using Representational Tools to Learn about Complex Systems: A Tale of Two Classrooms. , 2015 .

[149]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[150]  Rose M. Marra,et al.  College student epistemological perspectives across knowledge domains: A proposed grounded theory , 2004 .

[151]  T. Reeves,et al.  Systematic Review of Design-Based Research Progress , 2013 .

[152]  Tom Murray,et al.  Toward Measuring and Maintaining the Zone of Proximal Development in Adaptive Instructional Systems , 2002, Intelligent Tutoring Systems.