Assessment for Complex Learning Resources: Development and Validation of an Integrated Model

Todayâ??s e-learning systems meet the challenge to provide interactive, personalized environments that support self-regulated learning as well as social collaboration and simulation. At the same time assessment procedures have to be adapted to the new learning environments by moving from isolated summative assessments to integrated assessment forms. Therefore, learning experiences enriched with complex didactic resources - such as virtualized collaborations and serious games - have emerged. In this extension of [1] an integrated model for e-assessment (IMA) is outlined, which incorporates complex learning resources and assessment forms as main components for the development of an enriched learning experience. For a validation the IMA was presented to a group of experts from the fields of cognitive science, pedagogy, and e-learning. The findings from the validation lead to several refinements of the model, which mainly concern the component forms of assessment and the integration of social aspects. Both aspects are accounted for in the revised model, the former by providing a detailed sub-model for assessment forms.

[1]  Nicola Capuano,et al.  IWT: A Semantic Web-based Educational System , 2009 .

[2]  Robin H. Kay,et al.  Assessing emotions related to learning new software: The computer emotion scale , 2008, Comput. Hum. Behav..

[3]  Mohammad Al-Smadi,et al.  Enhancing wikis with visualization tools to support groups production function and to maintain task and social awareness , 2011 .

[4]  M. Al-Smadi,et al.  Towards an integrated assessment model for complex learning ressources: Findings from an expert validation , 2012, 2012 15th International Conference on Interactive Collaborative Learning (ICL).

[5]  Christian Gütl,et al.  An Integrated Model for E-assessment of Learning Experiences Enriched with Complex Learning Resources , 2011, 2011 Third International Conference on Intelligent Networking and Collaborative Systems.

[6]  Diane Dancer,et al.  Student involvement in assessment: a project designed to assess class participation fairly and reliably , 2005 .

[7]  D. Krathwohl Taxonomy of educational objectives: The Classification of educational goals. Handbook II: Affective domain / David R. Krathwohl, Benyamin S. Bloom, Bertram B. Masia , 1964 .

[8]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[9]  Russell G. Almond,et al.  Enhancing the Design and Delivery of Assessment Systems: A Four-Process Architecture , 2002 .

[10]  C. Boston The Concept of Formative Assessment. , 2002 .

[11]  O. R. Anderson,et al.  NEUROCOGNITIVE THEORY AND CONSTRUCTIVISM IN SCIENCE EDUCATION : A REVIEW OF NEUROBIOLOGICAL , COGNITIVE AND CULTURAL PERSPECTIVES , 2009 .

[12]  Chin-Chung Tsai,et al.  Taiwan college students' self-efficacy and motivation of learning in online peer assessment environments , 2010, Internet High. Educ..

[13]  S. Thompson Social Learning Theory , 2008 .

[14]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[15]  J. Biggs Enhancing teaching through constructive alignment , 1996 .

[16]  Nicole A. Buzzetto-More,et al.  Best Practices in e-Assessment , 2006, J. Inf. Technol. Educ..

[17]  Maria-Dolores Cano Students' Involvement in Continuous Assessment Methodologies: A Case Study for a Distributed Information Systems Course , 2011, IEEE Transactions on Education.

[18]  Dietrich Albert,et al.  The ELEKTRA Ontology Model: A Learner-Centered Approach to Resource Description , 2007, ICWL.

[19]  Randy Elliot Bennett,et al.  Inexorable and Inevitable: The Continuing Story of Technology and Assessment , 2002 .

[20]  Jeanette M. Bartley Assessment is as Assessment Does: A Conceptual Framework for Understanding Online Assessment and Measurement , 2005 .

[21]  Christian Guetl,et al.  Enhanced Approach of Automatic Creation of Test Items to Foster Modern Learning Setting , 2010 .

[22]  Christian Gütl,et al.  Assessment for/as Learning: Integrated Automatic Assessment in Complex Learning Resources for Self-Directed Learning , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[23]  Paul Gathercoal Principles of Assessment , 1995 .

[24]  F. Dochy,et al.  Assessment as a tool for learning , 1997 .

[25]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[26]  Robert McCormick,et al.  A common framework for e-learning quality , 2006 .

[27]  Janet Macdonald,et al.  Assessing online collaborative learning: process and product , 2003, Comput. Educ..

[28]  J. Bransford How people learn , 2000 .

[29]  Ae Griffin,et al.  Principles of Assessment , 2013 .

[30]  Christian Gütl,et al.  Investigating the suitability of automatically generated test items for real tests , 2012 .

[31]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[32]  Christian Gütl,et al.  Addressing e-Assessment practices in e-Learning Activities: A Review , 2011 .

[33]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[34]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .