Test-Driven Summarization: Combining Formative Assessment with Teaching Document Summarization

The diffusion of learning technologies has fostered the use of mobile and Web-based applications to assess the knowledge level of learners. In parallel, an increasing research interest has been devoted to studying new learning analytics tools able to summarize the content of large sets of learning documents. To bridge the gap between formative assessment tools and document summarization systems, this paper addresses the problem of recommending short summaries of large sets of learning documents based on the outcomes of multiple-choice tests. Specifically, it presents a new methodology for integrating formative assessment through mobile applications and summarization of learning documents in textual form. The content of the multiple-choice tests is exploited to drive the generation of document summaries tailored to specific topics. Furthermore, the outcomes of the tests are used to automatically recommend the generated summaries to learners based on their actual needs. As a case study, we performed an evaluation experience of students' progresses, which was conducted in the context of a university-level course. The achieved results show the applicability of the proposed methodology.

[1]  Stefano Paraboschi,et al.  Database Systems - Concepts, Languages and Architectures , 1999 .

[2]  Wahidah Husain,et al.  A Review on Predicting Student's Performance Using Data Mining Techniques , 2015 .

[3]  Liang-Yi Li,et al.  The Effect of Utilizing the Learning Skill of Highlighting and Constructing a Map in a Networked Hyperlink Condition on Learning Performance , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[4]  Christoph Meinel,et al.  Implementation and Evaluation of Digital E-Lecture Annotation in Learning Groups to Foster Active Learning , 2015, IEEE Transactions on Learning Technologies.

[5]  Stefano Paraboschi,et al.  Database Systems: Concepts, Languages & Architectures , 1999 .

[6]  Thomas R. Kratochwill,et al.  Educational Psychology: Effective Teaching, Effective Learning , 1993 .

[7]  Luning Zhang,et al.  Formative Assessment in English for Specific Purposes , 2016, 2016 Eighth International Conference on Measuring Technology and Mechatronics Automation (ICMTMA).

[8]  M. Shamim Hossain,et al.  ACO-based media content adaptation for e-learning environments , 2014, 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[9]  Philip S. Yu,et al.  Efficient mining of weighted association rules (WAR) , 2000, KDD '00.

[10]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[11]  S. Saraswathi,et al.  Multi-document Text Summarization in E-learning System for Operating System Domain , 2011, ACC.

[12]  Luca Cagliero,et al.  Generation and Evaluation of Summaries of Academic Teaching Materials , 2015, 2015 IEEE 39th Annual Computer Software and Applications Conference.

[13]  Camille Dickson-Deane,et al.  e-Learning, online learning, and distance learning environments: Are they the same? , 2011, Internet High. Educ..

[14]  Martín Llamas Nistal,et al.  Introducing BeA into Self-Regulated Learning to provide Formative Assessment support , 2016, 2016 IEEE Frontiers in Education Conference (FIE).

[15]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[16]  Haitao Xiong,et al.  Topic Detection from Short Text: A Term-based Consensus Clustering method , 2016, 2016 13th International Conference on Service Systems and Service Management (ICSSSM).

[17]  ELENA BARALIS,et al.  MWI-Sum: A Multilingual Summarizer Based on Frequent Weighted Itemsets , 2015, TOIS.

[18]  Nian-Shing Chen,et al.  Personalized Text Content Summarizer for Mobile Learning: An Automatic Text Summarization System with Relevance Based Language Model , 2012, 2012 IEEE Fourth International Conference on Technology for Education.

[19]  F. Ali,et al.  Impact of a Formative e-Assessment on Learning Outcomes: A Pilot Study on a Social and Behavioural Sciences Course, College of Health Sciences, University of Bahrain , 2015, 2015 Fifth International Conference on e-Learning (econf).

[20]  Luca Cagliero,et al.  Learning From Summaries: Supporting e-Learning Activities by Means of Document Summarization , 2016, IEEE Transactions on Emerging Topics in Computing.

[21]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[22]  Yang Song,et al.  An experiment with separate formative and summative rubrics in educational peer assessment , 2016, 2016 IEEE Frontiers in Education Conference (FIE).