Effective criteria of item analysis software

In Malaysia there is a move to abolish centralized assessments such as the Primary Six UPSR in 2012 and the Lower Secondary Three PMR Examinations. This is in line with the current global trend towards decentralising summative assessment and increased attention given to formative school and classroom based assessment. Therefore, this study aimed at developing and evaluating a user-friendly electronic item analysis and item banking software referred to SuperSETIA. Data was collected from teachers from three states using semi-structured interview questions and checklists. In relation to the usefulness of item analysis software, findings indicated that respondents were satisfied with the effectiveness criteria and the program content of the software. Majority of the respondents also concurred that the software is able to prepare teachers for real-world item analysis and teaching enhancement. Additionally, this study has helped the researchers obtain constructive feedback and the need to look into some key issues related to the user interface, audience appeal, navigation and presentation of the software. Last but not least, it is believed that with further exposure and training, this item analysis software can be widely accepted and used among the target audience.

[1]  Diana Laurillard,et al.  Rethinking University Teaching 2nd Edition: A conversational framework for the effective use of learning technologies , 2002 .

[2]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[3]  L W T Schuwirth,et al.  The use of clinical simulations in assessment , 2003, Medical education.

[4]  Diana Laurillard,et al.  Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies. 2nd Edition , 1993 .

[5]  Frederick G. Conrad,et al.  A heuristic evaluation of a World Wide Web prototype , 1996, INTR.

[6]  Qingping He,et al.  A computer-assisted test design and diagnosis system for use by classroom teachers , 2005, J. Comput. Assist. Learn..

[7]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[8]  A. Johnstone,et al.  The effect of language on student performance on multiple choice tests in chemistry , 1984 .

[9]  Mark Keil,et al.  Usefulness and ease of use: field study evidence regarding task considerations , 1995, Decis. Support Syst..

[10]  Michael Russell,et al.  EXAM QUESTION SEQUENCING EFFECTS ON MARKETING AND MANAGEMENT SCIENCES STUDENT PERFORMANCE , 2003 .

[11]  Fred D. Davis,et al.  Modeling the Determinants of Perceived Ease of Use , 1994, ICIS.

[12]  Fred D. Davis,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1 , 1992 .

[13]  D. Gefen,et al.  Lessons Learnt from the Successful Adoption of an ERP: The Central Role of Trust , 2000 .

[14]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..