Personalized multi-student improvement based on Bayesian cybernetics

This work presents innovative cybernetics (feedback) techniques based on Bayesian statistics for drawing questions from an Item Bank towards personalized multi-student improvement. A novel software tool, namely Module for Adaptive Assessment of Students (or, MAAS for short), implements the proposed (feedback) techniques. In conclusion, a pilot application to two Computer Science courses during a period of 4years demonstrates the effectiveness of the proposed techniques. Statistical evidence strongly suggests that the proposed techniques can improve student performance. The benefits of automating a quicker delivery of University quality education to a large body of students can be substantial as discussed here.

[1]  David J. Weiss,et al.  A Comparison of IRT-Based Adaptive Mastery Testing and a Sequential Mastery Testing Procedure , 1983 .

[2]  Charlie Daly,et al.  An automated learning system for Java programming , 2004, IEEE Transactions on Education.

[3]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[4]  Salvatore Valenti.  Information Technology for Assessing Student Learning , 2003, J. Inf. Technol. Educ..

[5]  David J. Weiss.  Proceedings of the 1977 Computerized Adaptive Testing Conference , 1977 .

[6]  Hua-Hua Chang,et al.  Computerized Adaptive Testing: A Comparison of Three Content Balancing Methods , 2003 .

[7]  José-Luis Pérez-de-la-Cruz,et al.  A Bayesian Diagnostic Algorithm for Student Modeling and its Evaluation , 2002, User Modeling and User-Adapted Interaction.

[8]  Norbert Wiener,et al.  Cybernetics: Control and Communication in the Animal and the Machine. , 1949 .

[9]  C. Lewis,et al.  Using Bayesian Decision Theory to Design a Computerized Mastery Test , 1990 .

[10]  Joanna Bull,et al.  Computer-assisted assessment in higher education , 1999 .

[11]  George D. Magoulas,et al.  INSPIRE: An INtelligent System for Personalized Instruction in a Remote Environment , 2001, OHS-7/SC-3/AH-3.

[12]  A Bayesian Procedure in the Context of Sequential Mastery Testing , 2000 .

[13]  Mike Thelwall,et al.  Computer-based assessment: a versatile educational tool , 2000, Comput. Educ..

[14]  Catherine Marinagi,et al.  PARES: a software tool for computer-based testing and evaluation used in the Greek higher education system , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[15]  Lawrence M. Rudner.  An Examination of Decision-Theory Adaptive Testing Procedures , 2009 .

[16]  Hahn-Ming Lee,et al.  Personalized e-learning system using Item Response Theory , 2005, Comput. Educ..

[17]  Bronwen Cowie,et al.  A Model of Formative Assessment in Science Education , 1999 .

[18]  Joanna Smailes.  Strategies for engaging students in computer based assessment – Stage 1, Taking stock , 2003 .

[19]  Neal M. Kingston,et al.  EXPLORING THE USE OF IRT EQUATING FOR THE GRE SUBJECT TEST IN MATHEMATICS , 1987 .

[20]  R. Owen,et al.  A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental Testing , 1975 .

[21]  María S. Pérez-Hernández,et al.  Are web self-assessment tools useful for training? , 2005, IEEE Transactions on Education.

[22]  Elena Trichina,et al.  Learning benefits of structural example-based adaptive tutoring systems , 2003, IEEE Trans. Educ..

[23]  Gopal Kanji,et al.  100 Statistical Tests , 1994 .

[24]  Angus S. McDonald,et al.  The impact of individual differences on the equivalence of computer-based and paper-and-pencil educational assessments , 2002, Comput. Educ..

[25]  Analía Amandi,et al.  Evaluating Bayesian networks' precision for detecting students' learning styles , 2007, Comput. Educ..

[26]  Walt Haney,et al.  Bridging the Gap between Testing and Technology in Schools , 2000 .

[27]  David J. Weiss,et al.  Book Review : New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing David J. Weiss (Ed.) New York: Academic Press, 1983, 345 pp., $35.00 , 1984 .

[28]  Chenn-Jung Huang,et al.  An intelligent learning diagnosis system for Web-based thematic learning platform , 2007, Comput. Educ..

[29]  P. Davies.  Learning through assessment OLAL ... On-line assessment and learning , 1999 .

[30]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[31]  Richard L. Ferguson.  Computer-Assisted Criterion-Referenced Measurement. , 1969 .

[32]  C.C. Marinagi,et al.  Work in progress - development and use of a software tool for improving the average student capacity in the Greek higher education system , 2004, 34th Annual Frontiers in Education, 2004. FIE 2004..

[33]  Demetrios G. Sampson,et al.  An Architecture for Web-based e-Learning Promoting Re-usable Adaptive Educational e-Content , 2002, J. Educ. Technol. Soc..

[34]  Mark D. Reckase,et al.  A Procedure for Decision Making Using Tailored Testing , 1983 .

[35]  Michalis Nik Xenos.  Prediction and assessment of student behaviour in open and distance education in computers using Bayesian networks , 2004, Comput. Educ..

[36]  Niall Sclater,et al.  User requirements of the "ultimate" online assessment engine , 2003, Comput. Educ..

[37]  Hua-Hua Chang,et al.  Content Balancing in Stratified Computerized Adaptive Testing Designs , 2000 .

[38]  Eduardo Guzmán,et al.  Improving Student Performance Using Self-Assessment Tests , 2007, IEEE Intelligent Systems.

[39]  Mariana Lilley,et al.  The development and evaluation of a software prototype for computer-adaptive testing , 2004, Comput. Educ..

[40]  Norbert Wiener,et al.  Cybernetics. , 1948, Scientific American.

[41]  Steven J. Rasmussen,et al.  Quantitative feedback theory: fundamentals and applications: C. H. Houpis and S. J. Rasmussen; Marcel Dekker, New York, 1999, ISBN: 0-8247-7872-3 , 2001, Autom..

[42]  Anthony R. Zara,et al.  Procedures for Selecting Items for Computerized Adaptive Tests. , 1989 .