Implementing computer-based assessment - A web-based mock examination changes attitudes

Interest in the educational use of information and communication technologies (ICT) in higher education is increasing. For successful implementation, it is important to know students' attitudes and reservations and how they can be positively influenced. The objective of the present study was to examine possible attitudinal changes towards computer-based assessment (CBA) in students, after undergoing one such assessment. A web-based mock examination was provided to all fourth year medical students at Leipzig Medical School in 2008 and 2009. Before and after the web test, students were asked to document their agreement with statements concerning CBA. A large number of students made use of the offered web-based assessment. 383 participants could be analysed for the pre-post comparisons. The majority of the students rated their computer self-efficacy as high. In summary, students' attitudes towards CBA in higher education tended to be positive. Gender differences seemed to be substantially influenced by differences in computer self-efficacy and were reduced considerably after only one practical experience. The actual experience had a positive influence on attitudes towards CBA. Nevertheless there were strong reservations about technical problems influencing the test performance when used for summative assessment. These concerns should not be ignored when trying to implement CBA. Optional formative CBA, perhaps early in higher education, seems to be a promising possibility of attracting students to computer- or web-based examination and learning methods, and may be a useful component of a successful implementation strategy.

[1]  Anastasios A. Economides,et al.  Computer based assessment: Gender differences in perceptions and acceptance , 2011, Comput. Hum. Behav..

[2]  J. Bortz Statistik für Human- und Sozialwissenschaftler , 2010 .

[3]  Lee A. Freeman,et al.  Are Men More Technology-Oriented Than Women? The Role of Gender on the Development of General Computer Self-Efficacy of College Students , 2010, AMCIS.

[4]  Timothy Teo,et al.  Modelling technology acceptance in education: A study of pre-service teachers , 2009, Comput. Educ..

[5]  Liwen Chen,et al.  Improving student performance in a first-year geography course: Examining the importance of computer-assisted formative assessment , 2011, Comput. Educ..

[6]  Antonio Padilla-Meléndez,et al.  Factors affecting e-collaboration technology use among management students , 2008, Comput. Educ..

[7]  J. W. Gikandi,et al.  Online formative assessment in higher education: A review of the literature , 2011, Comput. Educ..

[8]  Izaskun Ibabe,et al.  Online self-assessment with feedback and metacognitive knowledge , 2010 .

[9]  Aytekin Isman,et al.  HOW DOES STUDENT ABILITY AND SELF-EFFICACY AFFECT THE USAGE OF COMPUTER TECHNOLOGY? , 2009 .

[10]  T. Judd,et al.  First year students' experiences with technology: Are they really digital natives? , 2008 .

[11]  Dawn Birch,et al.  Bringing academics on board: encouraging institution-wide diffusion of e-learning environments , 2009 .

[12]  John Dermo,et al.  e-Assessment and the student learning experience: A survey of student perceptions of e-assessment , 2009, Br. J. Educ. Technol..

[13]  Rex Karsten,et al.  Business Student Computer Self-Efficacy: Ten Years Later , 2008, J. Inf. Syst. Educ..

[14]  M. Taras,et al.  ASSESSMENT – SUMMATIVE AND FORMATIVE – SOME THEORETICAL REFLECTIONS , 2005 .

[15]  Thorsten Berger,et al.  Eine dienste- und komponentenbasierte Architektur zur elektronischen Durchführung von Prüfungen und zum Management von Lehrveranstaltungen , 2006, GI Jahrestagung.

[16]  Raafat George Saadé,et al.  Computer Anxiety in E-Learning: The Effect of Computer Self-Efficacy , 2009, J. Inf. Technol. Educ..

[17]  M. Fitch,et al.  Using high-fidelity emergency simulation with large groups of preclinical medical students in a basic science course , 2007, Medical teacher.

[18]  E. Lim,et al.  Computer-based testing of the modified essay question: the Singapore experience , 2007, Medical teacher.

[19]  Eric W. T. Ngai,et al.  Empirical examination of the adoption of WebCT using TAM , 2007, Comput. Educ..

[20]  Ya-Ching Lee,et al.  The role of perceived resources in online learning adoption , 2008, Comput. Educ..

[21]  Darren Pullen,et al.  Case study of a computer based examination system , 2009 .

[22]  S DeAngelis,et al.  Equivalency of computer-based and paper-and-pencil testing. , 2000, Journal of allied health.

[23]  Gill Kirkup,et al.  Gender and cultural differences in Internet use: A study of China and the UK , 2007, Comput. Educ..

[24]  Ove Edvard Hatlevik,et al.  Gender-differences in Self-efficacy ICT related to various ICT-user profiles in Finland and Norway. How do self-efficacy, gender and ICT-user profiles relate to findings from PISA 2006 , 2011, Comput. Educ..

[25]  Anastasios A. Economides,et al.  The acceptance and use of computer based assessment , 2011, Comput. Educ..

[26]  Annemarie Hauf,et al.  Computers in education , 1983 .

[27]  R. Ogilvie,et al.  Students’ attitudes towards computer testing in a basic science course , 1999, Medical education.

[28]  Chula G. King,et al.  Online Exams and Cheating: An Empirical Analysis of Business Students' Views , 2009 .

[29]  Peter Cantillon,et al.  Using computers for assessment in medicine , 2004, BMJ : British Medical Journal.

[30]  Matthias Holzer,et al.  Einsatz eines fallbasierten Computerprüfungsinstruments in der klinischen Lehre: Akzeptanz der Studierenden / Veronika Kopp ... , 2004 .

[31]  Hsi-Peng Lu,et al.  The role of experience and innovation characteristics in the adoption and continued use of e-learning websites , 2008, Comput. Educ..

[32]  P. Reynolds,et al.  Online learning in dentistry: the changes in undergraduate perceptions and attitudes over a four year period , 2007, BDJ.

[33]  Thomas Link,et al.  Computer literacy and attitudes towards e-learning among first year medical students , 2006, BMC medical education.

[34]  G. Freund,et al.  BMC Medical Education BioMed Central , 2006 .

[35]  G. Kennedy,et al.  ‘Net Generation’ medical students: technological experiences of pre-clinical and clinical students , 2008, Medical teacher.

[36]  I. Erturk,et al.  Students' Perceptions of Online Assessment: A Case Study , 2004 .

[37]  Bridget D. Arend Encouraging Critical Thinking in Online Threaded Discussions. , 2009 .

[38]  Jerrell C. Cassady,et al.  The Effects of Online Formative and Summative Assessment on Test Anxiety and Performance , 2005 .

[39]  Tobias Richter,et al.  Computer Literacy, computerbezogene Einstellungen und Computernutzung bei männlichen und weiblichen Studierenden , 2001, MuC.

[40]  Denise Whitelock Editorial: e-assessment: developing new dialogues for the digital age , 2009, Br. J. Educ. Technol..