Mobile augmented reality based interactive teaching & learning system with low computation approach

This paper presents a fast and efficient hand gesture based mobile augmented reality (MAR) system for interactive classroom. It provides a complex visual augmented layer over static slides to understand the concepts more clearly without touching the computer devices or using whiteboard. Simple hand gestures are used to interact with slides while presenting in the classroom or in any conference room with high accuracy and efficiency without any expensive hardware. The gesture path is tracked continuously using a color tracking algorithm proposed. A decision tree is used to make the decisions based on the gestures. The preliminary result indicates that the gesture recognition rate is near about approximately 94% and it is mostly acceptable. This enhances the user's interaction level with immersive feeling in immersive environment.

[1]  S. Matsutomo,et al.  Real-Time Visualization System of Magnetic Field Utilizing Augmented Reality Technology for Education , 2012, IEEE Transactions on Magnetics.

[2]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[3]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[4]  Abhay Prakash,et al.  Control of computer process using image processing and computer vision for low-processing devices , 2012, ICACCI '12.

[5]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[6]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[7]  Pierre Dillenbourg,et al.  Technology for Classroom Orchestration , 2010 .

[8]  Vaishali S. Kulkarni,et al.  Appearance Based Recognition of American Sign Language Using Gesture Segmentation , 2010 .

[9]  F. W. Fikkert,et al.  Gesture Interaction at a Distance , 2010 .

[10]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[11]  Chong-Wah Ngo,et al.  Gesture tracking and recognition for lecture video editing , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[12]  Jemal H. Abawajy.  Advances in pervasive computing: GUEST EDITORIAL , 2009, Int. J. Pervasive Comput. Commun..

[13]  Bruce H. Thomas,et al.  Tinmith-Metro: new outdoor techniques for creating city models with an augmented reality wearable computer , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[14]  Dieter Schmalstieg,et al.  Managing Complex Augmented Reality Models , 2007, IEEE Computer Graphics and Applications.

[15]  Pattie Maes,et al.  WUW - wear Ur world: a wearable gestural interface , 2009, CHI Extended Abstracts.

[16]  Ieee Staff.  2014 IEEE Symposium on Computational Intelligence in Control and Automation (CICA) , 2014 .

[17]  Mohamed Alsheakhali,et al.  Hand Gesture Recognition System , 2011 .

[18]  Kay Hameyer,et al.  Methods for Computation and Visualization of Magnetic Flux Lines in 3-D , 2010, IEEE Transactions on Magnetics.

[19]  Dieter Schmalstieg,et al.  Tracking for Distributed Mixed Reality Environments , 2007 .