Analytics for Knowledge Creation: Towards Epistemic Agency and Design-Mode Thinking

Innovation and knowledge creation call for high-level epistemic agency and design-mode thinking, two competencies beyond the traditional scopes of schooling. In this paper, we discuss the need for learning analytics to support these two competencies, and more broadly, the demand for education for innovation. We ground these arguments on a distinctive Knowledge Building pedagogy that treats education as a knowledge-creation enterprise. By critiquing current learning analytics for their focus on static-state knowledge and skills, we argue for agency-driven, choice-based analytics more attuned to higher order competencies in innovation. We further describe ongoing learning analytics initiatives that attend to these elements of design. Prospects and challenges are discussed, as well as broader issues regarding analytics for higher order competencies.

[1]  Michel C. Desmarais,et al.  A review of recent advances in learner and skill modeling in intelligent learning environments , 2012, User Modeling and User-Adapted Interaction.

[2]  Allyson F. Hadwin,et al.  nStudy: Tracing and Supporting Self-Regulated Learning in the Internet , 2013 .

[3]  M. Scardamalia,et al.  Community Knowledge, Collective Responsibility: The Emergence of Rotating Leadership in Three Knowledge Building Communities , 2016, ICLS.

[4]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[5]  Bodong Chen.  Fostering scientific understanding and epistemic beliefs through judgments of promisingness , 2017 .

[6]  Leon Bieber,et al.  Mindset The New Psychology Of Success , 2016 .

[7]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[8]  Nobuko Fujita,et al.  Determining curricular coverage of student contributions to an online discourse environment through the use of latent semantic analysis and term clouds , 2009, CSCL.

[9]  Eric J. Johnson,et al.  Lateral prefrontal cortex and self-control in intertemporal choice , 2010, Nature Neuroscience.

[10]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[11]  Karen Littleton,et al.  Epistemology, Assessment, Pedagogy: Where Learning Meets Analytics in the Middle Space , 2014, J. Learn. Anal..

[12]  D. Krathwohl.  A Revision of Bloom's Taxonomy: An Overview , 2002 .

[13]  Jan van Aalst,et al.  Formative Assessment Of Computer-supported Collaborative Learning And Knowledge Building , 2016 .

[14]  A. Bandura.  Exercise of Human Agency Through Collective Efficacy , 2000 .

[15]  Scott W. Brown,et al.  Children’s Hypertext Navigation Strategies , 2002 .

[16]  Paul Prinsloo,et al.  Learning analytics: challenges, paradoxes and opportunities for mega open distance learning institutions , 2012, LAK '12.

[17]  K. Hakkarainen.  Progressive Inquiry in a Computer-Supported Biology Class , 2003 .

[18]  Janet E. Hurn,et al.  Using learning analytics to predict (and improve) student success: a faculty perspective , 2013 .

[19]  Katrien Verbert,et al.  Learning analytics as a "middle space" , 2013, LAK '13.

[20]  Cath Ellis,et al.  Broadening the scope and increasing the usefulness of learning analytics: The case for assessment analytics , 2013, Br. J. Educ. Technol..

[21]  Howard Gardner,et al.  More on private intuitions and public symbol systems , 1994 .

[22]  John D. Bransford,et al.  New Assessments and Environments for Knowledge Building , 2012 .

[23]  Jianwei Zhang,et al.  Fostering Sustained Knowledge Building through Metadiscourse Aided by the Idea Thread Mapper , 2015, CSCL.

[24]  Huang-Yao Hong,et al.  Schools as Knowledge-Building Organizations: Thirty Years of Design Research , 2016 .

[25]  Carlos Delgado Kloos,et al.  ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform , 2015, Comput. Hum. Behav..

[26]  Marlene Scardamalia,et al.  Beyond Bloom’s Taxonomy: Rethinking Knowledge for the Knowledge Age , 2005 .

[27]  Bodong Chen,et al.  18. Modi di contribuire ad un dialogo per la ricerca di spiegazioni , 2011 .

[28]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[29]  Marlene Scardamalia,et al.  The Development of Productive Vocabulary in Knowledge Building: A Longitudinal Study , 2015, CSCL.

[30]  K. Dunbar.  HOW SCIENTISTS REALLY REASON: SCIENTIFIC REASONING IN REAL-WORLD LABORATORIES , 1995 .

[31]  Eldar Shafir,et al.  Reason-based choice , 1993, Cognition.

[32]  P. Haas.  Introduction: epistemic communities and international policy coordination , 1992, International Organization.

[33]  Autonomy: The Aim of Education Envisioned by Piaget , 1984 .

[34]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[35]  Marlene Scardamalia,et al.  Group-level formative feedback and metadiscourse , 2015, Int. J. Comput. Support. Collab. Learn..

[36]  M. Scardamalia,et al.  Higher Levels of Agency for Children in Knowledge Building: A Challenge for the Design of New Knowledge Media , 1991 .

[37]  G. Hatano,et al.  TWO COURSES OF EXPERTISE , 1984 .

[38]  Alyssa Friend Wise,et al.  Designing pedagogical interventions to support student use of learning analytics , 2014, LAK.

[39]  Daniel L. Schwartz,et al.  Measuring What Matters Most: Choice-Based Assessments for the Digital Age , 2013 .

[40]  Carolyn Penstein Rosé,et al.  Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning , 2008, Int. J. Comput. Support. Collab. Learn..

[41]  Jianwei Zhang,et al.  Computer-Supported Metadiscourse to Foster Collective Progress in Knowledge-Building Communities , 2013, CSCL.

[42]  Jianwei Zhang,et al.  Making Collective Progress Visible for Sustained Knowledge Building , 2013, CSCL.

[43]  P. Prinsloo,et al.  Learning Analytics , 2013 .

[44]  Guy Claxton,et al.  Cultivating Creative Mentalities: A Framework for Education. , 2006 .

[45]  M. Scardamalia,et al.  Designs for Collective Cognitive Responsibility in Knowledge-Building Communities , 2009 .

[46]  Alex Pentland,et al.  Capturing Individual and Group Behavior with Wearable Sensors , 2009, AAAI Spring Symposium: Human Behavior Modeling.

[47]  Carl Bereiter,et al.  Education and Mind in the Knowledge Age , 2002 .

[48]  M. Scardamalia,et al.  Socio-cognitive dynamics of knowledge building in the work of 9- and 10-year-olds , 2007 .

[49]  Yoshiaki Matsuzawa,et al.  Knowledge Building Discourse Explorer: a social network analysis application for knowledge building discourse , 2012 .

[50]  David N. Perkins,et al.  Models and Moves: Focusing on Dimensions of Causal Complexity To Achieve Deeper Scientific Understanding. , 2000 .

[51]  J. Piaget.  A structural foundation for tomorrow's education , 1972 .

[52]  Christopher Teplovs,et al.  Tools for concurrent, embedded, and transformative assessment of knowledge building processes and progress , 2007, CSCL.

[53]  Gautam Biswas,et al.  Using Coherence Analysis to Characterize Self-Regulated Learning Behaviours in Open-Ended Learning Environments , 2015, J. Learn. Anal..

[54]  Matthew Berland,et al.  AMOEBA: Designing for collaboration in computer science classrooms through live learning analytics , 2015, International Journal of Computer-Supported Collaborative Learning.

[55]  Yuha Jung.  A New Culture of Learning: Cultivating the Imagination for a World of Constant Change , 2015 .

[56]  Siwei Lyu,et al.  Analyzing Online Knowledge-Building Discourse Using Probabilistic Topic Models , 2014, ICLS.

[57]  Jim Hewitt.  Beyond Threaded Discourse , 2001 .

[58]  M. Scardamalia,et al.  Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise , 1993 .

[59]  A. Collins,et al.  Epistemic Fluency and Constructivist Learning Environments. , 1995 .

[60]  M. Scardamalia,et al.  Self- organization in conceptual growth: practical implications , 2013 .

[61]  A. Sfard.  On Two Metaphors for Learning and the Dangers of Choosing Just One , 1998 .

[62]  MISSING-VALUE MISSING-VALUE,et al.  Knowledge Building , 2017 .

[63]  Gerry Stahl,et al.  Learning across levels , 2013, International Journal of Computer-Supported Collaborative Learning.

[64]  Peter A. Gloor,et al.  Swarm Creativity: Competitive Advantage Through Collaborative Innovation Networks , 2006 .

[65]  Huang-Yao Hong,et al.  Towards an idea-centered, principle-based design approach to support learning as knowledge creation , 2009 .

[66]  Marlene Scardamalia,et al.  Knowledge builgind and knowledge creation: theory, pedagogy and technology , 2014 .

[67]  Laura K. Allen,et al.  Are you reading my mind?: modeling students' reading comprehension skills with natural language processing techniques , 2015, LAK.

[68]  Huang-Yao Hong,et al.  Community knowledge assessment in a knowledge building environment , 2014, Comput. Educ..

[69]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[70]  Philip H. Winne,et al.  Inherent details in self-regulated learning , 1995 .

[71]  Chris Goldspink,et al.  Developing Resilient Agency in Learning: The Internal Structure of Learning Power , 2015 .

[72]  Daniel D. Suthers,et al.  Beyond threaded discussion: Representational guidance in asynchronous collaborative learning environments , 2008, Comput. Educ..

[73]  Carl Bereiter,et al.  Innovation in the Absence of Principled Knowledge: The Case of the Wright Brothers , 2009 .

[74]  Paul Prinsloo,et al.  Turning the tide: a socio-critical model and framework for improving student success in open distance learning at the University of South Africa , 2011 .

[75]  M. Scardamalia.  Collective cognitive responsibility for the advancement of knowledge , 2002 .

[76]  Peter W. Foltz,et al.  The Measurement of Textual Coherence with Latent Semantic Analysis. , 1998 .

[77]  Bodong Chen.  Visualizing semantic space of online discourse: the knowledge forum case , 2014, LAK '14.

[78]  Marlene Scardamalia,et al.  Advancing knowledge‐building discourse through judgments of promising ideas , 2015, Int. J. Comput. Support. Collab. Learn..