Development of Handheld Augmented Reality X-Ray for K-12 Settings

Mobile augmented reality is a next-generation interface for seamless ubiquitous learning. It offers many novel interactions that enable the visualization of digital information on real places and objects. These interactions require user-based testing for suitability in educational settings. One important interaction is augmented reality X-ray—providing an illusion to look inside objects. In this chapter, we implement augmented reality X-ray on a tablet computer by modifying the live video feed with computer graphics. Then, we evaluated our prototype based on the students’ perception of depth, legibility, and realism. Results show that augmented reality X-ray hampers legibility. However, it does not have a significant impact on the perception of depth and realism. In our interviews with teachers, we found that augmented reality X-ray is perceived to be useful because it promotes learning by experience. It has the potential to improve both student attention and motivation. However, the teachers require a high-quality lesson plan, and extra training to use augmented reality X-ray in the classroom effectively.

[1]  Arindam Dey,et al.  Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality , 2009, 2010 IEEE Virtual Reality Conference (VR).

[2]  Wernhuar Tarng,et al.  A Study of Campus Butterfly Ecology Learning System Based on Augmented Reality and Mobile Learning , 2012, 2012 IEEE Seventh International Conference on Wireless, Mobile and Ubiquitous Technology in Education.

[3]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[4]  Hideo Saito,et al.  Support system for guitar playing using augmented reality display , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[5]  Thomas A. Furness.  The Super Cockpit and its Human Factors Challenges , 1986 .

[6]  Goshiro Yamamoto,et al.  Augmented Reality X-Ray Interaction in K-12 Education: Theory, Student Perception and Teacher Evaluation , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[7]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[8]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[9]  Sofoklis Sotiriou,et al.  Visualizing the Invisible: The CONNECT Approach for Teaching Science , 2006 .

[10]  Arindam Dey,et al.  Tablet versus phone: Depth perception in handheld augmented reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[11]  Stefaan Ternier,et al.  Mobile Augmented Reality for Learning: A Case Study , 2011 .

[12]  Christian Sandor,et al.  An Evaluation of Augmented Reality X-Ray Vision for Outdoor Navigation , 2011 .

[13]  A. Freeman,et al.  The NMC Horizon Report: 2013 K-12 Edition. , 2009 .

[14]  Henry Been-Lirn Duh,et al.  Influences of AR-Supported Simulation on Learning Effectiveness in Face-to-face Collaborative Learning for Physics , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[15]  S. Matsutomo,et al.  Real-Time Visualization System of Magnetic Field Utilizing Augmented Reality Technology for Education , 2012, IEEE Transactions on Magnetics.

[16]  Hirokazu Kato,et al.  Authoring Augmented Reality Learning Experiences as Learning Objects , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[17]  Stefanie Zollmann,et al.  Image-based ghostings for single layer occlusions in augmented reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[18]  Manuel Castro,et al.  New technology trends in education: Seven years of forecasts and convergence , 2011, Comput. Educ..

[19]  Alan Levine,et al.  The 2010 Horizon Report. , 2010 .

[20]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[21]  Fiona Harrison,et al.  X-ray vision. , 2011, Scientific American.

[22]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[23]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[24]  Chris Dede,et al.  Augmented Reality Teaching and Learning , 2014 .

[25]  J. Edward Swan,et al.  Usability Engineering for Augmented Reality: Employing User-Based Studies to Inform Design , 2008, IEEE Transactions on Visualization and Computer Graphics.

[26]  Kurt Squire,et al.  Environmental Detectives—the development of an augmented reality platform for environmental simulations , 2008 .

[27]  Nassir Navab,et al.  mirracle: An augmented reality magic mirror system for anatomy education , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[28]  Mark A. Livingston,et al.  Evaluating Human Factors in Augmented Reality Systems , 2005, IEEE Computer Graphics and Applications.

[29]  Chris Dede,et al.  EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips , 2013, Comput. Educ..

[30]  Arindam Dey,et al.  An Augmented Reality X-Ray system based on visual saliency , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[31]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..