SMILE: an immersive learning game for deaf and hearing children

This paper describes the implementation and evaluation of the second iteration of SMILE (Science and Math in an Immersive Learning Environment), an immersive learning game that employs a fantasy 3D virtual environment to engage deaf and hearing children in math and science-based educational tasks. In this second iteration we (1) combine strategies used in commercial computer games with lessons from educational research on learning and motivation in order to increase the effectiveness of the application and the fun of its use, and (2) assess usability and appeal through a user study. To our knowledge, SMILE is the first bilingual immersive VLE (Virtual Learning Environment) for deaf and hearing students combining key elements of successful computer games, emotionally appealing graphics, and realistic real-time 3D signing, with goal-oriented, standards-based learning activities that are grounded in research on effective pedagogy.

[1]  K. H. Stauder,et al.  Psychology of the Child , 1959 .

[2]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[3]  Michael K. Thomas,et al.  Making learning fun: Quest Atlantis, a game without guns , 2005 .

[4]  J. Eastern.  Making Learning Fun , 2009 .

[5]  Deborah Hix,et al.  User-Centered Design and Evaluation of Virtual Environments , 1999, IEEE Computer Graphics and Applications.

[6]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[7]  J. Read,et al.  Endurability, Engagement and Expectations: Measuring Children’s Fun , 2002 .

[8]  Peter Bickford.  Interface design - the art of developing easy-to-use software , 1997 .

[9]  C. Boyatzis,et al.  Children's emotional associations with colors. , 1994, The Journal of genetic psychology.

[10]  K. Engelbrecht,et al.  The Impact of Color on Learning , 2003 .

[11]  Nicoletta Adamo-Villani,et al.  An immersive virtual environment for learning sign language mathematics , 2006, SIGGRAPH '06.

[12]  Maria Roussou,et al.  Learning by doing and learning through play: an exploration of interactivity in virtual environments for children , 2004, CIE.

[13]  Seymour Papert,et al.  Teaching children thinking (LOGO memo) , 1971 .

[14]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[15]  Thomas W. Malone,et al.  What makes things fun to learn? heuristics for designing instructional computer games , 1980, SIGSMALL '80.

[16]  Ben Shneiderman,et al.  Human factors of interactive software , 1983, Enduser Systems and Their Human Factors.

[17]  Seymour Papert,et al.  Teaching Children Thinking , 1972 .

[18]  William B. Borgers.  DEMOCRACY AND EDUCATION. , 1919 .

[19]  Mel Slater,et al.  Measuring Presence: A Response to the Witmer and Singer Presence Questionnaire , 1999, Presence.

[20]  Chuck Clanton,et al.  An interpreted demonstration of computer game design , 1998, CHI Conference Summary.

[21]  Joseph L. Gabbard.  A Taxonomy of Usability Characteristics in Virtual Environments , 1997 .

[22]  Daniel L. Duke,et al.  Does It Matter Where Our Children Learn , 1998 .

[23]  J R Lewis,et al.  Sample Sizes for Usability Studies: Additional Considerations , 1994, Human factors.

[24]  John T. Bell,et al.  Investigation and application of virtual reality as an educational tool , 1995 .

[25]  Deborah Hix,et al.  User-centered design and evaluation of a real-time battlefield visualization virtual environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[26]  Yongjoo Cho,et al.  Augmenting Elementary School Education with VR , 2002, IEEE Computer Graphics and Applications.

[27]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[28]  Ellen Mannel Grangaard.  Color and Light Effects on Learning. , 1995 .

[29]  Kirsten Risden,et al.  Evaluating computer game concepts with children , 2004, IDC '04.

[30]  Doug A. Bowman,et al.  A methodology for the evaluation of travel techniques for immersive virtual environments , 1998, Virtual Reality.

[31]  John C. Thomas,et al.  Metaphor and the Cognitive Representation of Computing Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[32]  Christine Youngblut,et al.  Educational Uses of Virtual Reality Technology. , 1998 .

[33]  C. McGuire,et al.  Office of Educational Research and Improvement , 1999 .

[34]  M. Lepper.  Motivational Considerations in the Study of Instruction , 1988 .