A case study on learning through natural ways of interaction

This paper presents a case study on using different input modalities in the perspective of a more natural way of interaction. The use of hand gestures and voice commands in a learning environment compared to the conventional ways of interaction is considered a significant parameter for the users' experience. This study investigates the correlation between the learning styles of a number of participants with the input modality being used. To conduct the study, an application which provides different ways of interaction was designed, developed and utilized. The results have shown that the 2-D motion device was the most prominent, as far as time of completion was concerned, because the users were more familiar with it. On the contrary, the natural ways of interaction were proven to be the most exciting by all participants. It is recorded that the natural way of interaction impels learners to participate and increases their motivation and engagement in learning activities.

[1]  Ton Mooij,et al.  Pupil-centred learning, ICT, and teacher behaviour: observations in educational practice , 2001, Br. J. Educ. Technol..

[2]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[3]  Alberto Del Bimbo.  Special issue on natural interaction , 2007, Multimedia Tools and Applications.

[4]  Peter A. Cooper.  Paradigm Shifts in Designed Instruction: From Behaviorism to Cognitivism to Constructivism. , 1993 .

[5]  Hao Zhang,et al.  Kinect Gesture Recognition for Interactive System , 2012 .

[6]  Nicu Sebe,et al.  Multimodal interfaces: Challenges and perspectives , 2009, J. Ambient Intell. Smart Environ..

[7]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[8]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[9]  Patricia Salinas,et al.  Kinesthetic Learning Applied to Mathematics Using Kinect , 2013, VARE.

[10]  Arko Lucieer,et al.  Gestural navigation in Google Earth , 2011, OZCHI.

[11]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[12]  Elwin Lee,et al.  Xdigit : An Arithmetic Kinect Game to Enhance Math Learning Experiences , 2012 .

[13]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[14]  Norman H. Villaroman,et al.  Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor , 2011, SIGITE '11.

[15]  Paloma Martínez,et al.  Towards the Achievement of Natural Interaction , 2009 .

[16]  Ricardo Gutierrez-Osuna,et al.  Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation , 2011, International journal of health geographics.

[17]  Maria Montessori,et al.  The Discovery of the Child , 1948 .

[18]  M. Tellier.  The effect of gestures on second language memorisation by young children , 2008 .

[19]  Kuo-Chung Chu,et al.  Development and Evaluation of Game-Based Learning System Using the Microsoft Kinect Sensor , 2015, Int. J. Distributed Sens. Networks.

[20]  Vicky Maratou,et al.  Enhance learning on software project management through a role-play game in a virtual world† , 2016, Interact. Learn. Environ..

[21]  Mario Fernando Montenegro Campos,et al.  Online gesture recognition from pose kernel learning and decision forests , 2014, Pattern Recognit. Lett..