VirtualTouch: A Tool for Developing Mixed Reality Educational Applications and an Example of Use for Inclusive Education

This article describes VirtualTouch, a tool for developing mixed reality educational applications. VirtualTouch proposes the use of virtual worlds and tangible user interfaces to offer a “mixed reality” experience. Using VirtualTouch a teacher may easily design learning modules, which are immediately implemented and used in the classroom. A first experience of such use, focused in the area of inclusive education, is also presented. The results of this experience are encouraging, showing that mixed reality applications have a high potential for use in this area.

[1]  Matej Zajc,et al.  Design-based research on the use of a tangible user interface for geometry teaching in an inclusive classroom , 2013, Br. J. Educ. Technol..

[2]  Salvador Sánchez Alonso,et al.  Language Learning in Educational Virtual Worlds - a TAM Based Assessment , 2013, J. Univers. Comput. Sci..

[3]  Willem Fontijn,et al.  On the Benefits of Tangible Interfaces for Educational Games , 2008, 2008 Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[4]  Tony P. Pridmore,et al.  Classroom collaboration in the design of tangible interfaces for storytelling , 2001, CHI.

[5]  Michael S. Horn,et al.  Designing tangible programming languages for classroom use , 2007, TEI.

[6]  Michael Herczeg,et al.  Tangicons: algorithmic reasoning in a collaborative game for children in kindergarten and first class , 2008, IDC.

[7]  Kristi Jauregi,et al.  The European Project TILA , 2013 .

[8]  Ying Li,et al.  A Tangible Tabletop Game Supporting Therapy of Children with Cerebral Palsy , 2008, Fun and Games.

[9]  Lilia B. Villafuerte,et al.  Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable , 2012, CHI Extended Abstracts.

[10]  R. Sternberg,et al.  The Psychology of Intelligence , 2002 .

[11]  M. Bers.  Identity Construction Environments: Developing Personal and Moral Values Through the Design of a Virtual City , 2001 .

[12]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[13]  日向 俊二.  Kinect for Windowsアプリを作ろう , 2012 .

[14]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[15]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[16]  D. Ketelhut.  The Impact of Student Self-efficacy on Scientific Inquiry Skills: An Exploratory Investigation in River City, a Multi-user Virtual Environment , 2007 .

[17]  Francisco Simões,et al.  A Dynamic Blocks Platform Based on Projective Augmented Reality and Tangible Interfaces for Educational Activities , 2013, 2013 XV Symposium on Virtual and Augmented Reality.

[18]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[19]  Kieron Sheehy.  Virtual Environments: Issues and Opportunities for Researching Inclusive Educational Practices , 2010, Researching Learning in Virtual Worlds.

[20]  Daniel B. Legoff,et al.  Use of LEGO© as a Therapeutic Medium for Improving Social Competence , 2004, Journal of autism and developmental disorders.

[21]  Sabarish V. Babu,et al.  Can Immersive Virtual Humans Teach Social Conversational Protocols? , 2007, 2007 IEEE Virtual Reality Conference.

[22]  Bárbara Paola Muro Haro,et al.  Developing reading skills in children with Down syndrome through tangible interfaces , 2012, MexIHC '12.

[23]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[24]  Mehul Agrawal,et al.  ChemicAble: Tangible Interaction Approach for learning Chemical Bonding , 2013, APCHI 2013.

[25]  Estrella Pulido,et al.  A Programming Experience of High School Students in a Virtual World Platform , 2011 .

[26]  Samuel Johnson,et al.  Squishy circuits: a tangible medium for electronics education , 2010, CHI EA '10.

[27]  Manfred Tscheligi,et al.  CHI '04 Extended Abstracts on Human Factors in Computing Systems , 2004, CHI 2004.

[28]  Michele D. Dickey.  Three-dimensional virtual worlds and distance learning: two case studies of Active Worlds as a medium for distance education , 2005, Br. J. Educ. Technol..

[29]  Hayes Solos Raffle,et al.  Collaborative Benefits of a Tangible Interface for Autistic Children , 2009 .

[30]  Shane Wilson,et al.  Using Game-Based Learning in Virtual Worlds to Teach Electronic and Electrical Engineering , 2013, IEEE Transactions on Industrial Informatics.

[31]  Magnus Moar,et al.  The Vertex project: exploring the creative use of shared 3D virtual worlds in the primary (K-12) classroom , 2002, SIGGRAPH '02.

[32]  Klaas van Veen,et al.  Constructing a Successful Cross-National Virtual Learning Environment in Primary and Secondary Education , 2006 .

[33]  Carles Fernandes Julià,et al.  TurTan: A tangible programming language for creative exploration , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[34]  J. Piaget.  The Psychology Of Intelligence , 1951 .

[35]  Fredrik Nilbrink,et al.  Designing tangible interfaces for children's collaboration , 2004, CHI EA '04.

[36]  Ali Jaoua,et al.  An Assistive Computerized System with Tangible User Interfaces for Children with Moderate Intellectual and Learning Disabilities , 2011, Int. J. Emerg. Technol. Learn..

[37]  Pep Simo,et al.  Low-Cost educational videos' for engineering students: a new concept based on video streaming and Youtube channels , 2011 .

[38]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[39]  Karen Stendal,et al.  Virtual worlds: A new opportunity for people with lifelong disability? , 2011, Journal of intellectual & developmental disability.

[40]  Alan F. Blackwell,et al.  Teaching rhetorical skills with a tangible user interface , 2004, IDC '04.

[41]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.