The Effects of Images on Multiple-choice Questions in Computer-based Formative Assessment

Current learning and assessment are evolving into digital systems that can be used, stored, and processed online. In this paper, three different types of questionnaires for assessment are presented. All the questionnaires were filled out online on a web-based format. A study was carried out to determine whether the use of images related to each question in the questionnaires affected the selection of the correct answer. Three questionnaires were used: two questionnaires with images (images used during learning and images not used during learning) and another questionnaire with no images, text-only. Ninety-four children between seven and eight years old participated in the study. The comparison of the scores obtained on the pre-test and on the post-test indicates that the children increased their knowledge after the training, which demonstrates that the learning method is effective. When the post-test scores for the three types of questionnaires were compared, statistically significant differences were found in favour of the two questionnaires with images versus the text-only questionnaire. No statistically significant differences were found between the two types of questionnaires with images. Therefore, to a great extent, the use of images in the questionnaires helps students to select the correct answer. Since this encourages students, adding images to the questionnaires could be a good strategy for formative assessment.

[1]  Maria del Carmen Juan Lizandra,et al.  The effects of computer-based games and collaboration in large groups vs. collaboration in pairs or traditional methods , 2015, Comput. Educ..

[2]  Eva Heinrich,et al.  Onscreen Marking Support for Formative Assessment , 2004 .

[3]  Curt J. Dommeyer,et al.  Attitudes of Business Faculty Towards Two Methods of Collecting Teaching Evaluations: Paper vs. Online , 2002 .

[4]  Thomas C. Reeves,et al.  Evaluation Strategies for Open and Distributed Learning Environments , 2007 .

[5]  Tzu-Hua Wang,et al.  Developing Web-based assessment strategies for facilitating junior high school students to perform self-regulated learning in an e-Learning environment , 2011, Comput. Educ..

[6]  Di Challis,et al.  Committing to quality learning through adaptive online assessment , 2005 .

[7]  Donald P. Ely,et al.  Assessing Learners Online , 2007 .

[8]  Ani Grubišić,et al.  E-Learning Paradigm & Intelligent Tutoring Systems , 2004 .

[9]  Gavin McArdle,et al.  Virtual reality for collaborative e-learning , 2008, Comput. Educ..

[10]  E. B. Andersen,et al.  A goodness of fit test for the rasch model , 1973 .

[11]  Liwen Chen,et al.  Improving student performance in a first-year geography course: Examining the importance of computer-assisted formative assessment , 2011, Comput. Educ..

[12]  Bruce Ravelli,et al.  Anonymous Online Teaching Assessments: Preliminary Findings. , 2000 .

[13]  Selma Vonderwell,et al.  Asynchronous Discussions and Assessment in Online Learning , 2007 .

[14]  Eduardo Guzmán,et al.  A web based collaborative testing environment , 2013, Comput. Educ..

[15]  Benjamin H. Layne,et al.  ELECTRONIC VERSUS TRADITIONAL STUDENT RATINGS OF INSTRUCTION , 1999 .

[16]  Jörg Wittwer,et al.  Pictures in Test Items: Effects on Response Time and Response Correctness , 2012 .

[17]  Chandler Stolp,et al.  The Visual Display of Quantitative Information , 1983 .

[18]  Muhterem Dindar,et al.  Multimedia in Test Items: Animated Questions vs. Static Graphics Questions , 2013 .

[19]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[20]  Yi-Shun Wang,et al.  Measuring e-learning systems success in an organizational context: Scale development and validation , 2007, Comput. Hum. Behav..

[21]  Martín Llamas Nistal,et al.  Blended e-assessment: Migrating classical exams to the digital world , 2013, Comput. Educ..

[22]  Tzu-Hua Wang,et al.  Developing an assessment-centered e-Learning system for improving student learning effectiveness , 2014, Comput. Educ..

[23]  John G. Keating,et al.  The VTIE Collaborative Writing Environment , 2006, WEBIST.

[24]  P. Gathy,et al.  Computer-assisted self-assessment (CASA) in histology , 1991 .

[25]  Anastasios A. Economides,et al.  The acceptance and use of computer based assessment , 2011, Comput. Educ..

[26]  Maria del Carmen Juan Lizandra,et al.  Playful interaction for learning collaboratively and individually , 2014, J. Ambient Intell. Smart Environ..

[27]  Aliaa A. A. Youssif,et al.  E-Assessment Tool: A Course Assessment Tool Integrated into Knowledge Assessment , 2008, Innovative Techniques in Instruction Technology, E-learning, E-assessment, and Education.

[28]  Susanne Narciss,et al.  Designing and Evaluating Tutoring Feedback Strategies for Digital Learning Environments on the Basis of the Interactive Tutoring Feedback Model. , 2013 .

[29]  E. Tufte,et al.  The visual display of quantitative information , 1984, The SAGE Encyclopedia of Research Design.

[30]  César Coll,et al.  Distribution of Feedback among Teacher and Students in Online Collaborative Learning in Small Groups , 2013 .

[31]  Inmaculada Plaza,et al.  Use of LMS functionalities in engineering education , 2011, 2011 Frontiers in Education Conference (FIE).

[32]  R. Rist,et al.  Ten Steps to a Results-Based Monitoring and Evaluation System: A Handbook for Development Practitioners , 2004 .

[33]  Gwo-Jen Hwang,et al.  A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students , 2011, Comput. Educ..

[34]  Curt J. Dommeyer,et al.  College Students' Attitudes Toward Methods of Collecting Teaching Evaluations: In-Class Versus On-Line , 2002 .

[35]  Jeff Cain,et al.  Online Student Course Evaluations: Review of Literature and a Pilot Study , 2005, American Journal of Pharmaceutical Education.

[36]  J. Cain,et al.  REVIEWS Online Student Course Evaluations: Review of Literature and a Pilot Study , 2005 .

[37]  Minhua Ma,et al.  A Flexible E-Assessment System Inspired by Design Methodology Management to Accommodate Diverse Learning Styles , 2010 .

[38]  Anna Espasa,et al.  Analysis of Feedback Processes in Online Group Interaction: A Methodological Model. , 2013 .

[39]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[40]  J. W. Pellegrino,et al.  Technology and Formative Assessment , 2010 .

[41]  J. W. Gikandi,et al.  Online formative assessment in higher education: A review of the literature , 2011, Comput. Educ..

[42]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[43]  Raoul A. Arreola,et al.  Developing a Comprehensive Faculty Evaluation System , 1995 .

[44]  Fotis Lazarinis,et al.  Creating personalized assessments based on learner knowledge and objectives in a hypermedia Web testing application , 2010, Comput. Educ..

[45]  Maria del Carmen Juan Lizandra,et al.  Flexible learning itinerary vs. linear learning itinerary , 2014, Sci. Comput. Program..

[46]  Patrick Griffin,et al.  Transforming Education: Assessing and Teaching 21st Century Skills , 2011 .

[47]  Tzu-Hua Wang,et al.  Web-based dynamic assessment: Taking assessment as teaching and learning strategy for improving students' e-Learning effectiveness , 2010, Comput. Educ..

[48]  Rosemary J. Avery,et al.  Please Scroll down for Article the Journal of Economic Education Electronic Course Evaluations: Does an Online Delivery System Influence Student Evaluations? , 2022 .

[49]  Ann L. Brown,et al.  Linking dynamic assessment with school achievement. , 1987 .

[50]  Robert W. Hanna,et al.  Gathering faculty teaching evaluations by in‐class and online surveys: their effects on response rates and evaluations , 2004 .

[51]  Hallie Preskill,et al.  Evaluation Strategies for Communicating and Reporting: Enhancing Learning in Organizations , 1996 .

[52]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.