Technology Enhanced Formative Assessment for 21st Century Learning

This article is based on the deliberations of the Assessment Working Group at EDUsummIT 2015 in Bangkok, Thailand. All of the members of Thematic Working Group 5 (TWG5) have contributed to this synthesis of potentials, concerns and issues with regard to the role of technology in assessment as, for and of learning in the 21st century.

[1]  Shi-Jinn Horng,et al.  Applying an online game-based formative assessment in a flowchart-based intelligent tutoring system for improving problem-solving skills , 2016, Comput. Educ..

[2]  Dirk Ifenthaler,et al.  Scope of Graphical Indices in Educational Diagnostics , 2010 .

[3]  Neel Sharma,et al.  A Qualitative Study on How Health Professional Students and Their PBL Facilitators Perceive the Use of Mobile Devices during PBL. , 2015 .

[4]  Susan M. Bridges.  An emic lens into online learning environments in PBL in undergraduate dentistry , 2015, Interdisciplinary and Intercultural Programmes in Higher Education.

[5]  Martin D. Beer,et al.  Pre-assessment and Learning Recommendation Mechanism for a Multi-agent System , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[6]  J. Michael Spector,et al.  Integrated and Holistic Perspectives on Learning, Instruction and Technology , 2000 .

[7]  Cath Ellis,et al.  Broadening the scope and increasing the usefulness of learning analytics: The case for assessment analytics , 2013, Br. J. Educ. Technol..

[8]  John Hattie,et al.  Visible learning for teachers: maximizing impact on learning, 1st Edition , 2012 .

[9]  M. Carter.  Visible learning: a synthesis of over 800 meta‐analyses relating to achievement , 2009 .

[10]  D. Wagner,et al.  Smaller, Quicker, Cheaper: Improving Learning Assessments for Developing Countries , 2011 .

[11]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[12]  S. Narciss.  Feedback Strategies for Interactive Learning Tasks , 2007 .

[13]  J. Michael Spector,et al.  Highly integrated model assessment technology and tools , 2010, CELDA 2008.

[14]  J. Michael Spector,et al.  Remarks on MOOCS and Mini-MOOCS , 2014, Educational Technology Research and Development.

[15]  Gilly Salmon,et al.  Experiential online development for educators: The example of the Carpe Diem MOOC , 2015, Br. J. Educ. Technol..

[16]  Michael J. Hannafin.  The Effects of Systematized Feedback on Learning in Natural Classroom Settings. , 1982 .

[17]  Marie B. Fisher,et al.  Eportfolio adoption and implementation in a multiple campus university environment- a reflection on opportunities and challenges in learning and teaching at the Australian Catholic University , 2015 .

[18]  Jingyan Lu,et al.  Effects of Video Triggers on the PBL Process , 2012 .

[19]  T. S. Hasselbring,et al.  Anchored Instruction: Why We Need It and How Technology Can Help , 2012 .

[20]  P. Black,et al.  Teachers developing assessment for learning: impact on student achievement , 2004 .

[21]  Linda Corrin,et al.  Student retention and learning analytics: A snapshot of Australian practices and a framework for advancement , 2015 .

[22]  Jun Jin,et al.  Educational Technologies in Problem-Based Learning in Health Sciences Education: A Systematic Review , 2014, Journal of medical Internet research.

[23]  Paul Black,et al.  Assessment for Learning in the Classroom , 2004 .

[24]  Dirk Ifenthaler,et al.  Computer-Based Diagnostics and Systematic Analysis of Knowledge , 2010 .

[25]  Dirk Ifenthaler,et al.  Intelligent Model-Based Feedback: Helping Learners to Monitor their Individual Learning Progress , 2012 .

[26]  J. Michael Spector,et al.  Model-Based Methods for Assessment, Learning, and Instruction: Innovative Educational Technology at Florida State University , 2009 .

[27]  Wim van den Noortgate,et al.  Adaptive item-based learning environments based on the item response theory: possibilities and challenges , 2010, J. Comput. Assist. Learn..

[28]  Mumtaz Begum Mustafa,et al.  A Review of Emotion Regulation in Intelligent Tutoring Systems , 2015, J. Educ. Technol. Soc..

[29]  Jorge Pérez,et al.  Informing and Performing: A Study Comparing Adaptive Learning to Traditional Learning , 2015, Informing Sci. Int. J. an Emerg. Transdiscipl..

[30]  Daniel V. Eastmond.  E-Moderating: The Key to Teaching and Learning Online , 2003 .

[31]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[32]  Vicky Lee Smart,et al.  Professional standards based digital portfolios vs. evidence based digital portfolios: Recommendations for creative, interesting and long-lasting digital portfolios , 2015 .

[33]  Ming Lui,et al.  Understanding the power of feedback in education: A validation study of the Feedback Orientation Scale (FOS) in classrooms , 2014 .

[34]  Cindy E. Hmelo-Silver,et al.  Educational Technologies in Medical and Health Sciences Education , 2016, Advances in Medical Education.

[35]  M. Shamim Hossain,et al.  Usability of a cloud-based collaborative learning framework to improve learners' experience , 2015, Comput. Hum. Behav..

[36]  J. Michael Spector.  Foundations of Educational Technology: Integrative Approaches and Interdisciplinary Perspectives , 2011 .

[37]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[38]  Jonathan Michael Spector,et al.  Conceptualizing the emerging field of smart learning environments , 2014, Smart Learning Environments.

[39]  D. Crookall.  Serious Games, Debriefing, and Simulation/Gaming as a Discipline , 2010 .

[40]  J. Michael Spector,et al.  Smart Learning Environments: Concepts and Issues , 2016 .

[41]  Peter Maurer,et al.  The Cambridge Handbook of the Learning Sciences , 2022 .

[42]  Susan Bridges,et al.  Blended learning and PBL: An interactional ethnographic approach to understanding knowledge construction in-situ , 2015 .

[43]  David Gibson.  ePortfolio Decisions and Dilemas , 2006 .

[44]  D. Gash.  E-moderating: the key to teaching and learning online , 2012 .

[45]  C. McGrath,et al.  Problem-based learning in clinical education: the next generation , 2012 .

[46]  G. Salomon,et al.  Skill may not be enough: The role of mindfulness in learning and transfer , 1987 .

[47]  P. Black,et al.  Working inside the Black Box: Assessment for Learning in the Classroom , 2004 .

[48]  V. Shute,et al.  Stealth Assessment: Measuring and Supporting Learning in Video Games , 2013 .

[49]  J. Michael Spector,et al.  Educational Technology Program and Project Evaluation , 2016 .

[50]  G. Brosvic,et al.  Immediate Feedback Assessment Technique Promotes Learning and Corrects Inaccurate first Responses , 2002 .

[51]  John A. Ross.  The Reliability, Validity, and Utility of Self-Assessment , 2006 .

[52]  Manwa L. Ng,et al.  Designing, implementing and evaluating an online problem-based learning (PBL) environment – A pilot study , 2014, Clinical linguistics & phonetics.

[53]  Barbara Crossouard,et al.  Transforming formative assessment in lifelong learning , 2013 .

[54]  D. Wood,et al.  Problem based learning , 2008, BMJ : British Medical Journal.

[55]  Brent Muirhead,et al.  E-tivities: The key to active online learning , 2002, J. Educ. Technol. Soc..

[56]  G. Alex Ambrose,et al.  360° Folio Networking: Enhancing Advising Interactions and Expanding Mentoring Opportunities with ePortfolios , 2015 .

[57]  V. Shute.  Focus on Formative Feedback. Research Report. ETS RR-07-11. , 2007 .

[58]  Gilly Salmon,et al.  E-tivities: the key to active online learning, 2nd ed. , 2002 .

[59]  Austin Gibbons,et al.  Learning Analytics , 2014, Encyclopedia of Social Network Analysis and Mining.

[60]  Cal Armstrong,et al.  Using Shared Microsoft OneNote “Binders” to Create a School Environment for Sharing, Continual Formative Assessment, & Information Organization , 2015 .

[61]  Mehmet Aydeniz,et al.  Formative Assessment: Improving Learning in Secondary Classrooms , 2009 .

[62]  Ekaterina Pechenkina,et al.  Digital Badges as a motivator in MooCs: The Carpe Diem MOOC Experience , 2016 .

[63]  Susan B. Neuman,et al.  Formative Assessment: Simply, No Additives , 2012 .

[64]  Sarah Brown.  The Impact of the ePortfolio Tool on the Process: Functional Decisions of a New Genre , 2015 .

[65]  Robert J. Mislevy,et al.  Evidence-Centered Assessment Design , 2017 .

[66]  P. Zimbardo,et al.  Transformational Teaching: Theoretical Underpinnings, Basic Principles, and Core Methods , 2012, Educational Psychology Review.

[67]  Kerry J. Kennedy,et al.  Teachers' Conceptions of Assessment in Chinese Contexts: A Tripartite Model of Accountability, Improvement, and Irrelevance. , 2011 .

[68]  Mary Webb,et al.  Challenges for information technology supporting educational assessment , 2013, J. Comput. Assist. Learn..

[69]  Julie White,et al.  Skills Recognition for the Rural Sector--Coming to a Screen Near You. , 2013 .

[70]  Jim E. Greer,et al.  Evaluation Methods for Intelligent Tutoring Systems Revisited , 2015, International Journal of Artificial Intelligence in Education.

[71]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[72]  Beverly Park Woolf,et al.  A Roadmap for Education Technology , 2011 .

[73]  Jason M. Harley,et al.  An Integrated Emotion-Aware Framework for Intelligent Tutoring Systems , 2015, AIED.

[74]  K. Holmes,et al.  Unleashing the Potential : Transforming Technical and Vocational Education and Training , 2015 .

[75]  Siriwan Suebnukarn,et al.  Expanding the Space of Plausible Solutions in a Medical Tutoring System for Problem-Based Learning , 2009, Int. J. Artif. Intell. Educ..

[76]  Terry Poulton,et al.  What Is Real? Using Problem-Based Learning in Virtual Worlds , 2016 .

[77]  D. Allen,et al.  What is Problem-Based Learning? , 2006 .

[78]  Roy B. Clariana,et al.  A comparison of answer until correct feedback and knowledge of correct response feedback under two conditions of contextualization , 1990 .

[79]  Dirk Ifenthaler.  AKOVIA: Automated Knowledge Visualization and Assessment , 2014, Technol. Knowl. Learn..

[80]  Ulrich Eggers,et al.  Visible Learning For Teachers Maximizing Impact On Learning , 2016 .

[81]  David Carless,et al.  Making productive use of exemplars: Peer discussion and teacher guidance for positive transfer of strategies , 2016 .

[82]  S. A. Becker,et al.  NMC Horizon Report: 2016 Higher Education Edition , 2015 .

[83]  Arthur C. Graesser,et al.  Feeling, Thinking, and Computing with Affect-Aware Learning Technologies , 2015 .

[84]  Susan Bull,et al.  Formative Assessment and Meaningful Learning Analytics , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[85]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[86]  R. Bennett.  Formative assessment: a critical review , 2011 .

[87]  Nermin Bulunuz,et al.  Achievement Levels of Middle School Students in the Standardized Science and Technology Exam and Formative Assessment Probes: A Comparative Study , 2016 .

[88]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[89]  J. Keller.  Motivational Design for Learning and Performance: The ARCS Model Approach , 2009 .