XML-based e-assessment system for Office skills in open learning environments

Learning and teaching systems have seen fast transformations being increasingly applied in emerging formal and informal education contexts. Indeed, the shift to open learning environments is remarkable, where the number of students is extremely high. To allow a huge amount of learners gaining new knowledge and skills in an open education framework, the recourse to e-assessment systems able to cover this strong demand and respective challenges is inevitable. Facing Office skills as those most frequently needed in education and business settings, in this paper, we address the design of a novel assessment system for automated assessment of Office skills in an authentic context. This approach exploits the powerful potential of the Extensible Markup Language (XML) format and related technologies by transforming the model of both students’ documents and answers to an XML format and extracting from the teacher’s correct document the required skills as patterns. To assign a mark, we measure similarities between the patterns of the students’ and the teacher’s documents. We conducted an experimental study to validate our approach for Word processing skills assessment and developed a system that was evaluated in a real exam scenario. The results demonstrated the accuracy and suitability of this research direction.

[1]  Ulf-Daniel Ehlers,et al.  Open Learning Cultures - A Guide to Quality, Evaluation, and Assessment for Future Learning , 2013 .

[2]  Zlatko J. Kovacic,et al.  Automatic Grading of Spreadsheet and Database Skills , 2012 .

[3]  Sally Jordan,et al.  E-assessment: Past, present and future , 2013 .

[4]  Stephen Arnold Assessing Student Learning Online: Overcoming Reliability Issues. , 2012, CELDA 2012.

[5]  Thomas G. Hill Excel grader and access grader , 2004, SGCS.

[6]  Zong De-cai Design and implementation of automatic scoring system for computer operation question , 2010 .

[7]  Kiyoshi Akama,et al.  Developing an e-learning System which enhances students' academic motivation , 2005, SIGUCCS '05.

[8]  Roy D. Dowsing,et al.  Knowledge-based systems for marking professional IT skills examinations , 2003, Knowl. Based Syst..

[9]  Mirina Grosz,et al.  World Wide Web Consortium , 2010 .

[10]  Li Jing-zhu Research and realization of automatic marking technology for Word operating-question , 2009 .

[11]  Daniela Tuparova,et al.  Automated real-live performance-based Assessment of ICT Skills , 2010 .

[12]  M. R. Sleep,et al.  Assessing word processing skills by computer , 1998 .

[13]  Thomas G. Hill Word grader and powerpoint grader , 2011, INROADS.

[14]  Tang Peng-jie Word Operation Automatic Marking System based on VBA , 2010 .

[15]  Chen Ling Design and implementation of automatic Word paper marking system , 2008 .

[16]  Fotis Lazarinis Designing an Enhanced Hypermedia Assessment Tool for End User ICT Certifications , 2006 .

[17]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[18]  Janet Hughes,et al.  Formative Automated Computer Testing (FACT) , 2002, Br. J. Educ. Technol..

[19]  Fintan Culwin Web hosted assessment—possibilities and policy , 1998, ITiCSE '98.

[20]  Roy D. Dowsing Assessing word-processing skills by event stream analysis , 2000, Int. J. Hum. Comput. Stud..

[21]  Christian Gütl,et al.  Past, Present and Future of e-Assessment: Towards a Flexible e-Assessment System , 2008 .

[22]  Ville Isomöttönen,et al.  PARSI: a tool for automatic assessment of office documents and basic IT skills , 2012, Koli Calling.