Towards the Design and Deployment of an Item Bank: An Analysis of the Requirements Elicited

Assessments are an important phase in the learning process. Information and communication technologies advancements determined the development of e-learning software tools which support e-learning activities, including e-assessment. The increasing usage of summative and formative e-assessments led to the challenge of managing items. The concept of an item bank is meant to support teachers and students alike, to provide an overview when taking assessments or creating exams. This article presents an on-going R&D project towards the design and deployment of an item bank for computer-based tests, and discusses its role within a service-oriented system architecture which enables the execution of activities related to e-assessment, ranging from item design and test creation, to the analysis of event logs generated by test-takers. The research methodology followed for the requirements elicitation and main findings are presented, and directions for future work are discussed.

[1]  Erik Voss,et al.  20 Years of Technology and Language Assessment in "Language Learning & Technology". , 2016 .

[2]  Erkki Sutinen,et al.  Success Factors for e-Assessment in Computer Science Education , 2008 .

[3]  Enric Mor,et al.  E-assessment system for skill and knowledge assessmentin computer engineering education , 2015 .

[4]  Mike Wald,et al.  Advantages and Challenges of Using e-Assessment , 2018 .

[5]  Lester Gilbert,et al.  Synthesis report on assessment and feedback with technology enhancement , 2011 .

[6]  Pru Marriott,et al.  Students' evaluation of the use of online summative assessment on an undergraduate financial accounting module , 2009, Br. J. Educ. Technol..

[7]  Mildred Murray-Ward,et al.  An NCME Instructional Module: Guidelines for the Development of Item Banks , 2005 .

[8]  Andrew R. Molnar Computers in education: A brief history , 1997 .

[9]  M. Hjermstad,et al.  Development of an item bank for computerized adaptive test (CAT) measurement of pain , 2015, Quality of Life Research.

[10]  Michael A. Jackson,et al.  Software requirements and specifications - a lexicon of practice, principles and prejudices , 1995 .

[11]  Klaus Pohl,et al.  Requirements Engineering - Fundamentals, Principles, and Techniques , 2010 .

[12]  Susan Lilly,et al.  Use case pitfalls: top 10 problems from real projects using use cases , 1999, Proceedings of Technology of Object-Oriented Languages and Systems - TOOLS 30 (Cat. No.PR00278).

[13]  Norbert Pachler,et al.  Exploring formative e‐assessment: using case stories and design patterns , 2010 .

[14]  Damras Wongsawang,et al.  Adaptable learning assistant for item bank management , 2008, Comput. Educ..

[15]  Joanna Bull,et al.  A Blueprint for Computer-Assisted Assessment , 2003 .

[16]  John Sargeant,et al.  Domain-specific formative feedback through domain-independent diagram matching , 2007 .

[17]  Ian Sommerville,et al.  Requirements Engineering: Processes and Techniques , 1998 .

[18]  Ian D Thomas,et al.  Authentic Assessment Applied to Engineering and Business Undergraduate Consulting Teams , 2002 .

[19]  Samuel Fricker,et al.  Requirements Engineering: Best Practice , 2015 .

[20]  Hugh C. Davis,et al.  Mapping the e-Learning Assessment Domain: Concept Maps for Orientation and Navigation , 2005 .