Interactive Graphics for Computer Adaptive Testing

Interactive graphics are commonly used in games and have been shown to be successful in attracting the general audience. Instead of computer games, animations, cartoons, and videos being used only for entertainment, there is now an interest in using interactive graphics for ‘innovative testing’. Rather than traditional pen‐and‐paper tests, audio, video and graphics are being conceived as alternative means for more effective testing in the future. In this paper, we review some examples of graphics item types for testing. As well, we outline how games can be used to interactively test concepts; discuss designing chemistry item types with interactive 3D graphics; suggest approaches for automatically adjusting difficulty level in interactive graphics based questions; and propose strategies for giving partial marks for incorrect answers. We study how to test different cognitive skills, such as music, using multimedia interfaces; and also evaluate the effectiveness of our model. Methods for estimating difficulty level of a mathematical item type using Item Response Theory (IRT) and a molecule construction item type using Graph Edit Distance are discussed. Evaluation of the graphics item types through extensive testing on some students is described. We also outline the application of using interactive graphics over cell phones. All of the graphics item types used in this paper are developed by members of our research group.

[1]  Horst Bunke,et al.  A graph distance metric based on the maximal common subgraph , 1998, Pattern Recognit. Lett..

[2]  Irene Cheng,et al.  An Algorithm for Automatic Difficulty Level Estimation of Multimedia Mathematical Test Items , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[3]  J. D. Bradley,et al.  Identification and rectification of student difficulties concerning three-dimensional structures, rotation, and reflection , 1991 .

[4]  R. F. Lyvers,et al.  A unique instructional tool for visualizing equipotentials and its use in an introductory fields course , 1993 .

[5]  Antonio Robles-Kelly,et al.  Graph edit distance from spectral seriation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  M. Kendall.  A NEW MEASURE OF RANK CORRELATION , 1938 .

[7]  H. Gardner,et al.  Frames of Mind: The Theory of Multiple Intelligences , 1983 .

[8]  Miro Kraetzl,et al.  Graph distances using graph union , 2001, Pattern Recognit. Lett..

[9]  Gordon I. McCalla,et al.  Utilizing Artificial Learners to Help Overcome the Cold-Start Problem in a Pedagogically-Oriented Paper Recommendation System , 2004, AH.

[10]  R. J. Mokken,et al.  Handbook of modern item response theory , 1997 .

[11]  Edwin R. Hancock,et al.  Bayesian graph edit distance , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[12]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[13]  Cynthia G. Parshall,et al.  Innovative Item Types for Computerized Testing , 2000 .

[14]  C. Seashore.  The Psychology of Musical Talent , 2009 .

[15]  Gustav Taxén.  Teaching computer graphics constructively , 2003, SIGGRAPH '03.

[16]  Steve Cunningham.  Re-inventing the introductory computer graphics course: providing tools for a wider audience , 2000, Comput. Graph..

[17]  Ann E. Barron,et al.  Multimedia Projects in Education: Designing, Producing, and Assessing , 1997 .

[18]  Victor M. S. Gil,et al.  Virtual environment of water molecules for learning and teaching science , 1999 .

[19]  Jianfeng Lu,et al.  Virtual learning environment for medical education based on VRML and VTK , 2005, Comput. Graph..

[20]  Irene Cheng,et al.  Improving Multimedia Innovative Item Types for Computer Based Testing , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[21]  Steve Cunningham,et al.  A hands-on environment for teaching GPU programming , 2007, SIGCSE.

[22]  Yngve Sundblad,et al.  Experience from 10 years of student projects oriented towards graphic interaction , 1996, Comput. Graph..

[23]  Robert J. Beichner,et al.  Education Research Using Web-Based Assessment Systems , 2000 .

[24]  Hsin-Chang Yang.  A general framework for automatically creating games for learning , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[25]  Stephen G. Sireci,et al.  Technological Innovations in Large-Scale Assessment , 2002 .

[26]  Dieter Schmalstieg,et al.  Mathematics and geometry education with collaborative augmented reality , 2003, Comput. Graph..

[27]  Irene Cheng,et al.  Multimedia Item Type Design for Assessing Human Cognitive Skills , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[28]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.