Open Assessment of Learning: A Meta-Synthesis

Open Assessment of Learning (OAoL) is an emerging educational concept derived from the incorporation of Information and Communication Technologies (ICT) to education and is related with the Open Education Movement. In order to improve understanding of OAoL a literature review was conducted as a meta-synthesis of 100 studies on ICT-based assessment published from 1995 to 2015, selected from well-established peer-reviewed databases. The purpose of this study focused on identifying the common topics between ICT-based assessment and OAoL which is considered as an Open Educational Practice.The review showed that extensive use of the Internet makes it easy to achieve some special features of OAoL as collaboration or sharing, which are considered negative or inconvenient in traditional assessment but at the same time become elements that promote innovation on that topic. It was also found that there is still a great resistance to accept change (as OAoL does) when structural elements of traditional assessment are questioned or challenged.

[1]  Lawrence A. Machi,et al.  The literature review : six steps to success , 2009 .

[2]  Mantz Yorke.  Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice , 2003 .

[3]  Athanasios Drigas,et al.  ICTs in Special Education: A Review , 2011, WSKS.

[4]  M. Sandelowski,et al.  Qualitative Metasynthesis: Reflections on Methodological Orientation and Ideological Agenda , 2004, Qualitative health research.

[5]  Ru-Chu Shih,et al.  Can Web 2.0 technology assist college students in learning English writing? Integrating Facebook and peer assessment with blended learning , 2011 .

[6]  M Sandelowski,et al.  Qualitative Metasynthesis : Issues and Techniques , 1997 .

[7]  María José Rodríguez Conde,et al.  Aplicación de las TIC a la evaluación de alumnos universitarios , 2005 .

[8]  D. Wiliam.  What Is Assessment for Learning , 2011 .

[10]  Lan Li,et al.  Assessor or assessee: How student learning improves by giving and receiving peer feedback , 2010, Br. J. Educ. Technol..

[11]  Wilfried Admiraal,et al.  Designing student peer assessment in higher education: analysis of written and oral peer feedback , 2006 .

[12]  Mien Segers,et al.  NUEVAS VÍAS DE APRENDIZAJE Y ENSEÑANZA Y SUS CONSECUENCIAS: UNA NUEVA ERA DE EVALUACIÓN , 2002 .

[13]  Manuel Cebrián de la Serna.  Los ePortafolios en la supervisión del Practicum: Modelos pedagógicos y soportes tecnológicos , 2011 .

[14]  Joke Voogt,et al.  Under which conditions does ICT have a positive effect on teaching and learning? A Call to Action , 2013, J. Comput. Assist. Learn..

[15]  Sally E. Jordan,et al.  e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback , 2009, Br. J. Educ. Technol..

[16]  S. Livingstone.  Critical reflections on the benefits of ICT in education , 2012 .

[17]  Rosa Maria Bottino,et al.  The evolution of ICT-based learning environments: which perspectives for the school of the future? , 2004, Br. J. Educ. Technol..

[18]  M. Denscombe.  The Good Research Guide: for small-scale social research projects , 1998 .

[19]  A. Joinson.  Understanding the Psychology of Internet Behaviour: Virtual Worlds, Real Lives , 2002 .

[20]  P. Black,et al.  Developing the theory of formative assessment , 2009 .

[21]  Qiyun Wang,et al.  A generic model for guiding the integration of ICT into teaching and learning , 2008 .

[22]  M. Cebrián,et al.  Study of the impact on student learning using the eRubric tool and peer assessment , 2011 .

[23]  A. Irons,et al.  Enhancing Learning through Formative Assessment and Feedback , 2007 .

[24]  L. F. A. Hernández,et al.  Rúbricas y autorregulación: pautas para promover una cultura de la autonomía en la formación profesional , 2014 .

[25]  Maryellen Weimer,et al.  Learner-Centered Teaching: Five Key Changes to Practice , 2013 .

[26]  J. W. Gikandi,et al.  Online formative assessment in higher education: A review of the literature , 2011, Comput. Educ..

[27]  Zoran Budimac,et al.  On the assessment and self‐assessment in a students teamwork based course on software engineering , 2011, Comput. Appl. Eng. Educ..

[28]  M.J. Gallego-Arrufat,et al.  Compromiso del estudiante y percepción del proceso evaluador basado en rúbricas , 2014 .

[29]  Charoula Angeli,et al.  Epistemological and methodological issues for the conceptualization, development, and assessment of ICT-TPCK: Advances in technological pedagogical content knowledge (TPCK) , 2009, Comput. Educ..

[30]  Martin Valcke,et al.  How effective are self- and peer assessment of oral presentation skills compared with teachers’ assessments? , 2012 .

[31]  Kathleen Montgomery,et al.  Authentic Tasks and Rubrics: Going Beyond Traditional Assessments in College Teaching , 2002 .

[32]  Ormond Simpson,et al.  Supporting Students in Online, Open and Distance Learning , 2000 .

[33]  Charles D. Dziuban,et al.  Faculty 2.0. , 2007 .

[34]  張基成,et al.  A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students. , 2012 .

[35]  S. Armstrong,et al.  Self-Assessment of Knowledge: A Cognitive Learning or Affective Measure? Perspectives From the Management Learning and Education Community , 2010 .

[36]  Joanna Bull,et al.  Assessing student learning in higher education , 1997 .

[37]  Chris Dobbyn,et al.  Assessment, feedback and marking guides in distance education , 2011 .

[38]  Jill Willis,et al.  Affiliation, autonomy and Assessment for Learning , 2011 .

[39]  C. Beaumont,et al.  Reconceptualising assessment feedback: a key to improving student learning? , 2011 .

[40]  D. Watson,et al.  Contextualized personality: traditional and new assessment procedures. , 2007, Journal of personality.

[41]  Christine Redecker,et al.  Changing Assessment — Towards a New Assessment Paradigm Using ICT , 2013 .

[42]  Lawrence A. Machi,et al.  The Literature Review: Six Steps to Success. Second Edition. , 2012 .

[43]  Eleazar Botta-Ferret,et al.  Minería de textos: una herramienta útil para mejorar la gestión del bibliotecario en el entorno digital , 2007 .

[44]  Nava Maslovaty,et al.  Promoting Motivational Goals through Alternative or Traditional Assessment. , 2002 .

[45]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[46]  Meredith Lawley,et al.  The Implementation of an Automated Assessment Feedback and Quality Assurance System for ICT Courses , 2007, J. Inf. Syst. Educ..

[47]  Shane Barry.  A video recording and viewing protocol for student group presentations: Assisting self-assessment through a Wiki environment , 2012, Comput. Educ..

[48]  Patrick Onghena,et al.  An inventory of peer assessment diversity , 2011 .

[49]  Mary E. Webb.  Affordances of ICT in science learning: implications for an integrated pedagogy , 2005 .

[50]  Eugenia M. W. Ng,et al.  Using wikis to develop student teachers' learning, teaching, and assessment capabilities , 2011, Internet High. Educ..

[51]  Gwo-Jen Hwang,et al.  A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students , 2011, Comput. Educ..

[52]  Manuela Raposo Rivasy,et al.  Electronic Rubrics to Assess Competences in ICT Subjects , 2014 .

[53]  Kristina N. Bauer,et al.  Self-Assessment of Knowledge: A Cognitive Learning or Affective Measure? , 2010 .

[54]  Dirk T. Tempelaar,et al.  Formative assessment and learning analytics , 2013, LAK '13.

[55]  R. Whittemore,et al.  The integrative review: updated methodology. , 2005, Journal of advanced nursing.

[56]  A. Bartolomé,et al.  La evaluación del aprendizaje en red mediante blogs y rúbricas: ¿complementos o suplementos? , 2014 .

[57]  J. Ahmed.  Documentary Research Method: New Dimensions , 2010 .

[58]  Connie L. McNeely,et al.  Globalization and the Growth of International Educational Testing and National Assessment , 2009, Comparative Education Review.

[59]  Caroline V. Gipps,et al.  What is the role for ICT-based assessment in universities? , 2005 .

[60]  Thanos Hatziapostolou,et al.  Enhancing the Impact of Formative Feedback on Student Learning through an Online Feedback System. , 2010 .

[61]  Chi-Cheng Chang,et al.  A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students , 2012, Comput. Educ..

[62]  Jeremy Knox.  The limitations of access alone: Moving towards open processes in education technology , 2013 .

[63]  S. Chaudhary,et al.  Assessment in Open and Distance Learning System (ODL): A Challenge , 2013 .

[64]  Michael L. Vanderwood,et al.  Traditional Assessment, Consultation, and Intervention Practices: Urban School Psychologists' Use, Importance, and Competence Ratings , 2008 .

[65]  A. Heck,et al.  Comparison of Traditional Instruction on Reflection and Rotation in a Nepalese High School with an ICT-Rich, Student-Centered, Investigative Approach , 2017 .

[66]  Anders Jonsson,et al.  The Use of Scoring Rubrics for Formative Assessment Purposes Revisited: A Review. , 2013 .

[67]  Enric Serradell-López,et al.  An analysis of the determinants of students' performance in e-learning , 2014, Comput. Hum. Behav..

[68]  Cameron Richards,et al.  THE DESIGN OF EFFECTIVE ICT-SUPPORTED LEARNING ACTIVITIES: EXEMPLARY MODELS, CHANGING REQUIREMENTS, AND NEW POSSIBILITIES , 2005 .

[69]  D. Boud,et al.  Peer Learning and Assessment , 1999 .

[70]  Lela V. Zimmer,et al.  Qualitative meta-synthesis: a question of dialoguing with texts. , 2006, Journal of advanced nursing.

[71]  A. Astin,et al.  Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation in Higher Education. American Council on Education/Macmillan Series on Higher Education. , 1991 .

[72]  Cher Ping Lim,et al.  Information and Communication Technologies (ICT) in Primary Education , 2013 .

[73]  Caroline V. Gipps *.  What is the role for ICT‐based assessment in universities? , 2005 .

[74]  Axel Bruns,et al.  Mobile learning in review: Opportunities and challenges for learners, teachers, and institutions , 2006 .

[75]  Joke Voogt,et al.  Consequences of ICT for aims, contents, processes and environments of learning , 2004 .

[76]  F. Bry,et al.  Education in a technological world : communicating current and emerging research and technological efforts , 2011 .

[77]  Ibis Marlene Álvarez Valdivia,et al.  Evaluar para contribuir a la autorregulación del aprendizaje , 2017 .

[78]  S. Downe,et al.  Meta-synthesis method for qualitative research: a literature review. , 2005, Journal of advanced nursing.

[79]  Mike Joy,et al.  Computer support of effective peer assessment in an undergraduate programming class , 2007, J. Comput. Assist. Learn..