Evaluation of alternative instructional strategies in intelligent coaching systems: an empirical study

Computer-based adaptive teaching can enhance individual learning effectiveness. Several researches have defined the concepts of Intelligent Coaching Systems and adaptive teaching in the past. However, empirical findings are limited to anecdotal evidence guiding the design of these systems. A prototype system based on the idea of adaptive teaching is built in Knowledge Pro which monitors a learning task. The learning task is on the topic of forecasting and forecasting models. The system monitors the student's performance and generate responses in the context of the student needs and student dialogue history. In this research the focus is on the expert evaluation and student performance modules. The expert evaluation module holds the declarative and procedural knowledge of domain concepts and the learning task performance process. The student performance module develops an overlay model of the student based on the expert evaluation module. The adaptive teaching module intervenes to minimize the gap between the student performance model and the expert evaluation model. The objectives of this research were to test: (1) the effectiveness of adaptive teaching and (2) the effectiveness of two instructional strategies concerning content in improving learning in a laboratory environment. The empirical results show that (1) adaptive teaching increases learning and learner satisfaction (2) instructions that provoke thought improve learning and satisfaction more than instructions that are specific to the problem and its solutions. The findings have the potential to enhance the effectiveness of teachers by creating learning environments that focus on the needs of individual students.

[1]  La Follette,et al.  Interactivity and Multimedia Instruction: Crucial Attributes for Design and Instruction. , 1993 .

[2]  B Fazlollahi,et al.  Using expert systems/hypermedia technologies to develop interactive learning environments. , 1994 .

[3]  James H. Watt,et al.  Effects of Educational Setting on Student Responses to Structured Hypertext. , 1991 .

[4]  Jakob Nielsen,et al.  The art of navigating through hypertext , 1990, CACM.

[5]  Gary Thomas Howell Building Hypermedia Applications: A Software Development Guide , 1992 .

[6]  William Leigh,et al.  Graphical representation of help knowledge for intelligent tutoring systems , 1992 .

[7]  Ramesh Sharda,et al.  Decision support system effectiveness: a review and an empirical test , 1988 .

[8]  Dov Te'eni,et al.  Feedback in DSS as a Source of Control: Experiments with the Timing of Feedback , 1991 .

[9]  M. David Merrill,et al.  The role of tutorial and experiential models in intelligent tutoring systems , 1990 .

[10]  Edward Barrett Text, ConText, and HyperText: Writing with and for the Computer , 1991 .

[11]  Elaine England Interactional Analysis: The Missing Factor in Computer-Aided Learning Design and Evaluation. , 1985 .

[12]  Albert T. Corbett,et al.  Intelligent Tutoring Systems , 1985, Science.

[13]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[14]  David H. Jonassen,et al.  Hypertext as instructional design , 1991 .

[15]  David S. Murphy,et al.  Expert Systems versus Traditional Methods for Teaching Accounting Issues , 1992 .

[16]  Geri Gay,et al.  Designing and Testing Navigational Strategies and Guidance Tools for a Hypermedia Program , 1991 .

[17]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[18]  Jay Liebowitz,et al.  KARTT: A Multimedia Tool to Help Students Learn Knowledge Acquisition , 1993 .

[19]  Ian M. Graham Object-oriented methods , 1991 .

[20]  David Merrill,et al.  An Expert System for Instructional Design , 1987, IEEE Expert.

[21]  Thomas D. McFarland,et al.  Expert systems in education and training , 1990 .

[22]  Alan F. Smeaton Using hypertext for computer based learning , 1991 .

[23]  Mark S. Silver,et al.  Decisional Guidance for Computer-Based Decision Support , 1991, MIS Q..

[24]  Vijay K. Vaishnavi,et al.  Smart objects: a tool for building intelligent support systems , 1993, [1993] Proceedings of the Twenty-sixth Hawaii International Conference on System Sciences.

[25]  Michael Orey Three Years of Intelligent Tutoring Evaluation: A Summary of Findings. , 1993 .