Application of immersive technologies for education: State of the art

Existing multimedia systems used in education mostly address only two senses by using two communication channels (visual and audio) of the five human senses (sight, hearing, taste, smell, and touch), limiting the potential efficiency of learning. This paper presents a survey on existing technical opportunities for the development of an immersive learning environment. Four components of the immersive environment - visual, audio, olfactory, and haptic are described and discussed in the paper. In particular 3D displays, head mounted devices, 3D sound systems, olfactory displays, haptic devices, and interaction devices are presented.

[1]  Stephen R. Gulliver,et al.  Multiple Sensorial Media Advances and Applications: New Developments in MulSeMedia , 2011 .

[2]  Marco Agus,et al.  HAPTIC AND VISUAL SIMULATION OF BONE DISSECTION , 2004 .

[3]  Mark Lucente.  Interactive three-dimensional holographic displays: seeing the future in depth , 1997, COMG.

[4]  Yasushi Ikei,et al.  A theater for viewing and editing multi-sensory content , 2011, 2011 IEEE International Symposium on VR Innovation.

[5]  George Ghinea,et al.  Information recall task impact in olfaction-enhanced multimedia , 2013, TOMCCAP.

[6]  Jacquelyn Ford Morie,et al.  The effects of scent and game play experience on memory of a virtual environment , 2007, Virtual Reality.

[7]  Weisi Lin,et al.  Mulsemedia: State of the Art, Perspectives, and Challenges , 2014, TOMM.

[8]  George Ghinea,et al.  Olfaction-enhanced multimedia: perspectives and challenges , 2011, Multimedia Tools and Applications.

[9]  Gabriel-Miro Muntean,et al.  User-profile-based perceived olfactory and visual media synchronization , 2014, ACM Trans. Multim. Comput. Commun. Appl..

[10]  Tibor Balogh,et al.  The HoloVizio system , 2006, Electronic Imaging.

[11]  Joshua Napoli,et al.  100-million-voxel volumetric display , 2002, SPIE Defense + Commercial Sensing.

[12]  Andrew Jones,et al.  Achieving eye contact in a one-to-many 3D video teleconferencing system , 2009, ACM Trans. Graph..

[13]  Joseph Kaye,et al.  Making Scents: aromatic output for HCI , 2004, INTR.

[14]  Joseph Nathaniel Kaye,et al.  Symbolic olfactory display , 2001 .

[15]  Gabriel-Miro Muntean,et al.  Subjective evaluation of olfactory and visual media synchronization , 2013, MMSys.

[16]  Gabriel-Miro Muntean,et al.  Olfaction-Enhanced Multimedia , 2016, ACM Comput. Surv..

[17]  Gabriel-Miro Muntean,et al.  Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media Delivery , 2015, IEEE Transactions on Multimedia.

[18]  Gabriel-Miro Muntean,et al.  User Quality of Experience of Mulsemedia Applications , 2014, TOMM.

[19]  Alexandre N. Tuch,et al.  Opportunities for odor: experiences with smell and implications for technology , 2014, CHI.

[20]  Gabriel-Miro Muntean,et al.  Age and gender influences on perceived olfactory and visual media synchronization. , 2013 .

[21]  George Ghinea,et al.  Perceived Synchronization of Olfactory Multimedia , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Ron Chi-Wai Kwok,et al.  Design of affectively evocative smart ambient media for learning , 2009, AMC '09.

[23]  Gabriel-Miro Muntean,et al.  Multiple-Scent Enhanced Multimedia Synchronization , 2014, TOMM.

[24]  Gabriel-Miro Muntean,et al.  Age and gender influence on perceived olfactory & visual media synchronization , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Janez Podobnik,et al.  Haptics for Virtual Reality and Teleoperation , 2012 .

[26]  GHEORGHITA GHINEA,et al.  User perception of media content association in olfaction-enhanced multimedia , 2012, TOMCCAP.

[27]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[28]  Christian Timmerer,et al.  Sensory Experience: Quality of Experience Beyond Audio-Visual , 2014, Quality of Experience.