An Innovative Approach for Assisting Teachers in Improving Instructional Strategies via Analyzing Historical Assessment Data of Students

Identifying learning problems of students has been recognized as an important issue for assisting teachers in improving their instructional skills or learning design strategies. The accumulated assessment data provide an excellent resource for achieving this objective. However, most of conventional testing systems only record students' test results, which are not helpful to teachers in realizing students' learning problems without further assistance. To cope with this problem, in this study, an innovative approach that combines a student concept model and the change mining mechanism is proposed to analyze the learning problems of students from their historical assessment data. The teachers received the analysis results and then used those suggestions to improve their instructional strategies. To evaluate the performance of the proposed approach, a web-based learning assessment system has been developed and an experiment has been conducted on an "Introduction to Computers" course in a university. The experimental results showed that, those analysis results provided by the innovative approach were helpful to the teachers in providing appropriate instructional assistance and remedial learning materials for improving the learning achievements of the students.

[1]  Wynne Hsu,et al.  Mining association rules with multiple minimum supports , 1999, KDD '99.

[2]  Jean MacGregor,et al.  Learning Communities: Reforming Undergraduate Education , 2004 .

[3]  S. Maria Josephine Arokia Marie,et al.  Relevance of Item Analysis in Standardizing an Achievement Test in Teaching of Physical Science in B.Ed Syllabus. , 2015 .

[4]  Tzone-I Wang,et al.  Construction and analysis of educational assessments using knowledge maps with weight appraisal of concepts , 2010, Comput. Educ..

[5]  Chuen-Tsai Sun,et al.  Breaking concept boundaries to enhance creative potential: Using integrated concept maps for conceptual self-awareness , 2008, Comput. Educ..

[6]  Gwo-Jen Hwang,et al.  Development of a diagnostic and remedial learning system based on an enhanced concept–effect model , 2013 .

[7]  Gwo-Jen Hwang,et al.  Diagnosing student learning problems based on historical assessment records , 2008 .

[8]  Gwo-Jen Hwang,et al.  A group decision approach to developing concept-effect models for diagnosing student learning problems in mathematics , 2013, Br. J. Educ. Technol..

[9]  Tzu-Chien Liu,et al.  Supporting Teachers in Identifying Students' Learning Styles in Learning Management Systems: An Automatic Student Modelling Approach , 2009, J. Educ. Technol. Soc..

[10]  Sebastián Ventura,et al.  Applying Web usage mining for personalizing hyperlinks in Web-based adaptive educational systems , 2009, Comput. Educ..

[11]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[12]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[13]  Kalina Yacef,et al.  Measuring Correlation of Strong Symmetric Association Rules in Educational Data , 2010 .

[14]  Mohamed Jemni,et al.  Automatic Recommendations for E-Learning Personalization Based on Web Usage Mining Techniques and Information Retrieval , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[15]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[16]  Rafael A. Calvo,et al.  Concept Maps as Cognitive Visualizations of Writing Assignments , 2011, J. Educ. Technol. Soc..

[17]  D. DavisFred,et al.  User Acceptance of Computer Technology , 1989 .

[18]  Yuen-Hsien Tseng,et al.  Mining concept maps from news stories for measuring civic scientific literacy in media , 2010, Comput. Educ..

[19]  Philip S. Yu,et al.  Targeting the right students using data mining , 2000, KDD '00.

[20]  Chun-Hsiung Lee,et al.  Application of automatically constructed concept map of learning to conceptual diagnosis of e-learning , 2009, Expert Syst. Appl..

[21]  Judy Kay,et al.  Capturing and analyzing verbal and physical collaborative learning interactions at an enriched interactive tabletop , 2013, Int. J. Comput. Support. Collab. Learn..

[22]  Gary McCulloch,et al.  The Routledge International Encyclopedia of Education , 2008 .

[23]  Rob Koper,et al.  La rappresentazione del Learning Design di Unità di Apprendimento , 2006 .

[24]  Gwo-Jen Hwang,et al.  A test-sheet-generating algorithm for multiple assessment requirements , 2003, IEEE Trans. Educ..

[25]  Meng Chang Chen,et al.  Extending the TAM model to explore the factors that affect Intention to Use an Online Learning Community , 2010, Comput. Educ..

[26]  Bin Shyan Jong,et al.  Diagnostic and remedial learning strategy based on conceptual graphs , 2004, J. Comput. Assist. Learn..

[27]  Gwo-Jen Hwang,et al.  A Heuristic Algorithm for planning personalized learning paths for context-aware ubiquitous learning , 2010, Comput. Educ..

[28]  Yao-Ting Sung,et al.  A New Assessment for Computer-based Concept Mapping , 2005, J. Educ. Technol. Soc..

[29]  Soung Hie Kim,et al.  Mining the change of customer behavior in an internet shopping mall , 2001, Expert Syst. Appl..

[30]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[31]  Gwo-Jen Hwang,et al.  A conceptual map model for developing intelligent tutoring systems , 2003, Comput. Educ..

[32]  Tzone-I Wang,et al.  A mining-based approach on discovering courses pattern for constructing suitable learning path , 2010, Expert Syst. Appl..

[33]  Chih-Kai Chang,et al.  Development of a reading material recommendation system based on a knowledge engineering approach , 2010, Comput. Educ..

[34]  Gwo-Jen Hwang,et al.  An enhanced learning diagnosis model based on concept–effect relationships with multiple knowledge levels , 2010 .

[35]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[36]  H. Coates.  The value of student engagement for higher education quality assurance , 2005 .

[37]  Chih-Ming Chen,et al.  Mobile formative assessment tool based on data mining techniques for supporting web-based learning , 2009, Comput. Educ..

[38]  Zoran Budimac,et al.  E-Learning personalization based on hybrid recommendation strategy and learning style identification , 2011, Comput. Educ..

[39]  Edward B. Nuhfer.  The Place of Formative Evaluations in Assessment and Ways to Reap Their Benefits , 1996 .

[40]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[41]  Gwo-Jen Hwang,et al.  A multi-expert approach for developing testing and diagnostic systems based on the concept-effect model , 2010, Comput. Educ..

[42]  Gwo-Jen Hwang,et al.  A novel approach for assisting teachers in analyzing student web-searching behaviors , 2008, Comput. Educ..

[43]  Pei-Lin Liu,et al.  Effects of a computer-assisted concept mapping learning strategy on EFL college students' English reading comprehension , 2010, Comput. Educ..

[44]  Duen-Ren Liu,et al.  Mining the change of event trends for decision support in environmental scanning , 2009, Expert Syst. Appl..

[45]  Ray-I Chang,et al.  Data mining for providing a personalized learning path in creativity: An application of decision trees , 2013, Comput. Educ..

[46]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[47]  Wynne Hsu,et al.  Integrating Classification and Association Rule Mining , 1998, KDD.