Revista ELectrónica de Investigación y EValuación Educativa

One of the essential functions of university teachers lies in the decision-making process regarding the various components included in assessment process design, where the quality of assessment tasks is a key aspect. This study presents both validation of an instrument for students to evaluate the assessment tasks and the model that upholds the relationships between constructs that characterise the assessment tasks. Working from a review of the literature, a theoretical model has been devised featuring the characteristics of the assessment tasks and the relationships between them. The Analysis of the Assessment and Learning Tasks questionnaire (ATAE) has been designed to check them, based on a formative measurement model. Using a cohort design, a total of 1,166 questionnaires were obtained, completed by students from the Business Administration and Management (BAM) and Finance and Accounting (F&A) degree courses. The measurement model and the structural model were evaluated by means of the Partial Least Squares Structural Equation Modeling (PLS-SEM) technique using SmartPLS_3 software. The results show no collinearity problems plus high levels of absolute and relative importance for each questionnaire item. From the students’ perception, it should be highlighted that the challenging aspect of an assessment task is related to transfer of learning, and that this is measured by use of communication strategies and demonstration of in-depth understanding.

[1]  G. Rodríguez-Gómez,et al.  Evaluando la evaluación. Validación mediante PLS-SEM de la escala ATAE para el análisis de las tareas de evaluación , 2020, RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa.

[2]  D. Boud.  Challenges in reforming higher education assessment: a perspective from afar , 2020 .

[3]  Jaione Cubero Ibáñez,et al.  Aprendiendo a través de Tareas de Evaluación Auténticas: Percepción de Estudiantes de Grado en Educación Infantil , 2020 .

[4]  María Soledad Ibarra-Sáiz,et al.  Developing student competence through peer assessment: the role of feedback, self-regulation and evaluative judgement , 2020, Higher Education.

[5]  Galit Shmueli,et al.  Predictive model assessment in PLS-SEM: guidelines for using PLSpredict , 2019, European Journal of Marketing.

[6]  Rocío Jiménez-Cortés.  Aprendizaje de las mujeres en las redes sociales: Validación de la escala MAIA con PLS , 2019, Revista de Investigación Educativa.

[7]  J. Muñoz-Cantero,et al.  Validación del cuestionario de atribuciones para la detección de coincidencias en trabajos académicos , 2019, RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa.

[8]  Joseph F. Hair,et al.  When to use and how to report the results of PLS-SEM , 2019, European Business Review.

[9]  T. Thomas,et al.  Students’ perspectives of early assessment tasks in their first-year at university , 2018, Assessment & Evaluation in Higher Education.

[10]  David Boud,et al.  Developing evaluative judgement: enabling students to make decisions about the quality of work , 2018 .

[11]  Pratyush Nidhi Sharma,et al.  Prediction-Oriented Model Selection in Partial Least Squares Path Modeling , 2018, Decis. Sci..

[12]  S. Brookhart,et al.  Fusing self-regulated learning and formative assessment: a roadmap of where we are, how we got here, and where we are going , 2018 .

[13]  Berry M. O’Donovan.  How student beliefs about knowledge and knowing influence their satisfaction with assessment and feedback , 2017 .

[14]  D. Boud,et al.  How university teachers design assessments: a cross-disciplinary study , 2017 .

[15]  Marko Sarstedt,et al.  Advanced Issues in Partial Least Squares Structural Equation Modeling , 2017 .

[16]  S. Järvelä,et al.  Third wave of measurement in the self-regulated learning field: when measurement and intervention come hand in hand , 2016 .

[17]  D. Royce Sadler,et al.  Three in-course assessment reforms to improve higher education learning outcomes , 2016 .

[18]  Galit Shmueli,et al.  The elephant in the room: Predictive performance of PLS models , 2016 .

[19]  Christian Nitzl,et al.  Mediation Analysis in Partial Least Squares Path Modeling: Helping Researchers Discuss More Sophisticated Models , 2016, Ind. Manag. Data Syst..

[20]  Sue Bennett,et al.  Support for assessment practice: developing the Assessment Design Decisions Framework , 2016 .

[21]  Velda McCune,et al.  Reflective Teaching in Higher Education , 2015 .

[22]  K. Struyven,et al.  Criteria and standards of generic competences at bachelor degree level: A review study , 2015 .

[23]  N. Entwistle,et al.  Perceptions of assessment and their influences on learning , 2014 .

[24]  Jan Herrington,et al.  Establishing the critical elements that determine authentic assessment , 2014 .

[25]  Sue Bennett,et al.  Assessment Might Dictate the Curriculum, but What Dictates Assessment? , 2013 .

[26]  John G. Lynch,et al.  Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis , 2010 .

[27]  P. Kirschner,et al.  A five-dimensional framework for authentic assessment , 2004 .

[28]  John B. Biggs,et al.  Teaching for Quality Learning at University: What the Student Does , 1999 .

[29]  Likert Scaling , 2022, The SAGE Encyclopedia of Research Design.

[30]  Bruce B. Frey,et al.  The Sage encyclopedia of educational research, measurement, and evaluation , 2018 .

[31]  Christian Nitzl,et al.  Mediation Analyses in Partial Least Squares Structural Equation Modeling: Guidelines and Empirical Examples , 2017 .

[32]  Ra Glofcheski,et al.  Making Assessment for Learning Happen Through Assessment Task Design in the Law Curriculum , 2017 .

[33]  L. Niklasson,et al.  Students’ perceptions of assessment: a comparative analysis between Portugal and Sweden , 2017 .

[34]  Sophia Decker,et al.  Assessment For Learning In Higher Education , 2016 .

[35]  María Soledad Ibarra-Sáiz,et al.  Assessment as Learning and Empowerment: Towards Sustainable Learning in Higher Education , 2015 .

[36]  D. Boud.  Shifting Views of Assessment: From Secret Teachers’ Business to Sustaining Learning , 2014 .

[37]  Lisa F. Smith,et al.  Developing Assessment Tasks , 2014 .

[38]  Methodological considerations in the measurement of subjective well-being 2. METHODOLOGICAL CONSIDERATIONS IN THE MEASUREMENT OF SUBJECTIVE WELL-BEING , 2019 .

[39]  Manuel J. Sánchez-Franco,et al.  Variance-Based Structural Equation Modeling: Guidelines for Using Partial Least Squares in Information Systems Research , 2012 .

[40]  M. Guerra.  La evaluación como aprendizaje , 2010 .

[41]  F. Dochy.  The Edumetric Quality of New Modes of Assessment: Some Issues and Prospects , 2009 .

[42]  M. Northcote,et al.  Higher Education Students' Perceptions of Effective Assessment , 2009 .

[43]  P. Kirschner,et al.  RELATIONS BETWEEN STUDENT PERCEPTIONS OF ASSESSMENT AUTHENTICITY, STUDY APPROACHES AND LEARNING OUTCOME , 2006 .

[44]  Jan Herrington,et al.  Authentic conditions for authentic assessment: aligning task and assessment , 2006 .

[45]  Lieven Verschaffel,et al.  Instructional psychology : past, present, and future trends : sixteen essays in honour of Eric de Corte , 2006 .

[46]  Wynne W. Chin.  The partial least squares approach for structural equation modeling. , 1998 .

[47]  A. Correspondent,et al.  “The Elephant” , 1972, Nature.