Framework for Instructional Technology: Methods of Implementing Adaptive Training and Education

Abstract : In adaptive instructional environments, instructional interventions and/or content are adapted to an individual learner's competence level, goals, or other characteristics. The intention behind adaptation is to maintain the optimal level of challenge for each individual student, to provide support, and to correct misconceptions. This report provides a framework in which to consider various technology-based adaptive instructional techniques. The Framework for Instructional Technology (FIT) lays out four categories of adaptive techniques: Corrective Feedback, Support, Micro-sequencing, and Macro-sequencing. Under each category, FIT specifies five levels or approaches to adapting that correspond to degree of adaptive sophistication and complexity of implementation. With few exceptions, evidence supporting the use of higher levels of adaptation is lacking. This is because the systematic comparison of different implementation approaches has not been conducted. The report provides recommendations for combining different levels of FIT with different levels of interactive multimedia instruction. FIT can be used to clearly describe adaptive behaviors and to guide future research investigating the efficacy of different adaptive instructional interventions.

[1]  Stephan Dutke,et al.  Evaluation of two types of online help for application software , 2008, J. Comput. Assist. Learn..

[2]  D. Wood,et al.  Help seeking, learning and contingent tutoring , 1999, Comput. Educ..

[3]  Valerie J. Shute,et al.  Intelligent Tutoring Systems: Past, Present, and Future. , 1994 .

[4]  K. VanLehn The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[5]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[6]  Randall D. Spain,et al.  Framework for instructional technology , 2012 .

[7]  Slava Kalyuga,et al.  Measuring Knowledge to Optimize Cognitive Load Factors During Instruction. , 2004 .

[8]  Paula J. Durlach,et al.  BiLAT: A Game-Based Environment for Practicing Negotiation in a Cultural Context , 2009, Int. J. Artif. Intell. Educ..

[9]  D. R. Billings,et al.  Efficacy of Adaptive Feedback Strategies in Simulation-Based Training , 2012 .

[10]  Davide Fossati,et al.  Automatic modeling of procedural knowledge and feedback generation in a computer science tutoring system , 2009 .

[11]  S. Narciss Feedback Strategies for Interactive Learning Tasks , 2007 .

[12]  Valerie J. Shute,et al.  A Comparison of Learning Environments: All That Glitters , 1992 .

[13]  R. W. Kulhavy,et al.  Feedback in written instruction: The place of response certitude , 1989 .

[14]  J. Merriënboer,et al.  Selecting learning tasks: Effects of adaptation and shared control on learning efficiency and task involvement☆ , 2008 .

[15]  Kenneth R. Koedinger,et al.  Automated Student Model Improvement , 2012, EDM.

[16]  D. K. Peeler,et al.  The U , 2002 .

[17]  Chen-Lin C. Kulik,et al.  Effectiveness of Mastery Learning Programs: A Meta-Analysis , 1990 .

[18]  Antonija Mitrovic,et al.  The effect of positive feedback in a constraint-based intelligent tutoring system , 2013, Comput. Educ..

[19]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[20]  Andreas S. Pomportsis,et al.  The value of adaptivity based on cognitive style: an empirical study , 2004, Br. J. Educ. Technol..

[21]  Vincent Aleven,et al.  Worked Examples and Tutored Problem Solving: Redundant or Synergistic Forms of Support? , 2009, Top. Cogn. Sci..

[22]  Robert J. Mislevy,et al.  An evidence centered design for learning and assessment in the digital world , 2010 .

[23]  R. Azevedo,et al.  Scaffolding Self-regulated Learning and Metacognition – Implications for the Design of Computer-based Scaffolds , 2005 .

[24]  Natalie B. Steinhauser,et al.  Review of Adaptive Training System Techniques , 2012 .

[25]  Rose Luckin,et al.  Ecolab: the development and evaluation of a Vygotskian design framework , 1999 .

[26]  Maria Virvou,et al.  Evaluating the intelligent features of a web-based intelligent computer assisted language learning system , 2004, Int. J. Artif. Intell. Tools.

[27]  K. Koedinger,et al.  Improving students’ help-seeking skills using metacognitive feedback in an intelligent tutoring system , 2011, Learning and Instruction.

[28]  V. Shute,et al.  Adaptive Technologies , 2007 .

[29]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[30]  T. Guskey,et al.  Research on Group-Based Mastery Learning Programs: A Meta-Analysis , 1988 .

[31]  Matthew Jensen Hays,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition When and Why a Failed Test Potentiates the Effectiveness of Subsequent Study , 2012 .

[32]  Michel C. Desmarais,et al.  A review of recent advances in learner and skill modeling in intelligent learning environments , 2012, User Modeling and User-Adapted Interaction.

[33]  Yoon Jeon Kim,et al.  Formative and Stealth Assessment , 2014 .

[34]  Vincent Aleven,et al.  Effects of different ratios of worked solution steps and problem solving opportunities on cognitive load and learning outcomes , 2011, Comput. Hum. Behav..

[35]  T. S. Hilbert,et al.  Example-Based Learning in Heuristic Domains: A Cognitive Load Theory Account , 2009 .

[36]  Eduardo Salas,et al.  Teamwork: emerging principles , 2000 .

[37]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[38]  V. Aleven,et al.  Help Seeking and Help Design in Interactive Learning Environments , 2003 .

[39]  Geraldine Clarebout,et al.  Benefits of inserting support devices in electronic learning environments , 2009, Comput. Hum. Behav..

[40]  B. Bloom Human Characteristics and School Learning , 1979 .

[41]  Yu Guo,et al.  Trying to Reduce Bottom-Out Hinting: Will Telling Student How Many Hints They Have Left Help? , 2008, Intelligent Tutoring Systems.

[42]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[43]  Neil T. Heffernan,et al.  Expanding the Model-Tracing Architecture: A 3rd Generation Intelligent Tutor for Algebra Symbolization , 2008, Int. J. Artif. Intell. Educ..

[44]  Allen Munro,et al.  Instruction intrusiveness in dynamic simulation training , 1985 .

[45]  Roy,et al.  The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning , Education , and Human Activity , 2004 .

[46]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[47]  A. Kluger,et al.  Task type as a moderator of positive/negative feedback effects on motivation and performance: A regulatory focus perspective , 2011 .

[48]  Julita Vassileva,et al.  Course sequencing techniques for large-scale web-based education , 2003 .

[49]  Gwo-Jen Hwang,et al.  Development of an adaptive learning system with two sources of personalization information , 2008, Comput. Educ..

[50]  D. Sadler Formative assessment and the design of instructional systems , 1989 .

[51]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[52]  Paula J Durlach,et al.  Cultural Awareness and Negotiation Skills Training: Evaluation of a Prototype Semi-Immersive System , 2008 .

[53]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[54]  Arthur C. Graesser,et al.  Agent Technologies Designed to Facilitate Interactive Knowledge Construction , 2008 .

[55]  Ok-Choon Park,et al.  Adaptive Instructional Systems , 2007 .

[56]  Beverly Park Woolf,et al.  Building Intelligent Interactive Tutors: Student-centered Strategies for Revolutionizing E-learning , 2008 .

[57]  C. Reigeluth Technology-Enhanced Support Strategies for Inquiry Learning , 2008 .

[58]  Paula J Durlach,et al.  Designing Adaptive Instructional Environments: Insights from Empirical Evidence , 2011 .

[59]  Geraldine Clarebout,et al.  The contribution of learner characteristics in the development of computer-based adaptive learning environments , 2011, Comput. Hum. Behav..

[60]  Matthew L. Miller,et al.  Feedback Types in Programmed Instruction: A Systematic Review , 2007 .

[61]  Diane J. Litman,et al.  Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system , 2011, Comput. Speech Lang..

[62]  Robert T Hays,et al.  The Effectiveness of Instructional Games: A Literature Review and Discussion , 2005 .