Effect of kinesthetic and tactile haptic feedback on the quality of experience of edutainment applications

Haptic technologies and applications have received enormous attention in the last decade. The incorporation of haptic modality into multimedia applications adds excitement and enjoyment to an application. It also adds a more natural feel to multimedia applications, that otherwise would be limited to vision and audition, by engaging as well the user’s sense of touch, giving a more intrinsic feel essential for ambient intelligent applications. However, the improvement of an application’s Quality of Experience (QoE) by the addition of haptic feedback is still not completely understood. The research presented in this paper focuses on the effect of haptic feedback and what it potentially adds to the experience of the user as opposed to the traditional visual and auditory feedback. In essence, it investigates certain issues regarding stylus-based haptic education applications and haptic-enhanced entertainment videos. To this end, we used two haptic applications: the haptic handwriting learning tool to experiment with force feedback haptic interaction and the tactile YouTube application for tactile haptic feedback. In both applications, our analysis shows that the addition of haptic feedback will increase the QoE in the absence of fatigue or discomfort for this category of applications. This implies that the incorporation of haptic modality (both force feedback as well as tactile feedback) has positively contributed to the overall QoE for the users.

[1]  Vijay Pawar,et al.  Evaluating the Influence of Haptic Force-Feedback on 3D Selection Tasks using Natural Egocentric Gestures , 2009, 2009 IEEE Virtual Reality Conference.

[2]  R. Bryan Greenway,et al.  Effects of tactile information on telerobotic performance , 1993, Other Conferences.

[3]  Mindy F. Levin,et al.  Effect of Tactile Feedback on Movement Speed and Precision During Work-Related Tasks Using a Computer Mouse , 2005, Hum. Factors.

[4]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[5]  Touradj Ebrahimi.  Quality of multimedia experience: past, present and future , 2009, MM '09.

[6]  Abdulmotaleb El-Saddik,et al.  HugMe: A haptic videoconferencing system for interpersonal communication , 2008, 2008 IEEE Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems.

[7]  El Saddik,et al.  The Potential of Haptics Technologies , 2007, IEEE Instrumentation & Measurement Magazine.

[8]  Allison M. Okamura,et al.  Effects of haptic and graphical force feedback on teleoperated palpation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  M. Eid,et al.  A Multimedia Handwriting Learning and Evaluation Tool , 2007 .

[10]  Abdulmotaleb El-Saddik,et al.  A haptic multimedia handwriting learning system , 2007, Emme '07.

[11]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[12]  Emile H. L. Aarts,et al.  Ambient intelligence: a multimedia perspective , 2004, IEEE MultiMedia.

[13]  N. Georganas,et al.  A comparison of Mamdani and Sugeno fuzzy inference systems for evaluating the quality of experience of Hapto-Audio-Visual applications , 2008, 2008 IEEE International Workshop on Haptic Audio visual Environments and Games.

[14]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[15]  Jenny Dankelman,et al.  The Effect of Augmented Feedback on Grasp Force in Laparoscopic Grasp Control , 2010, IEEE Transactions on Haptics.

[16]  Abdulmotaleb El-Saddik,et al.  A quality of experience model for haptic user interfaces , 2008, HAS '08.

[17]  G. Roid.  Quality of Performance and Change-Sensitive Assessment of Cognitive Ability , 2004 .

[18]  Thomas E. Whalen,et al.  Measuring the human side of virtual reality , 2003, IEEE International Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2003. VECIMS '03. 2003.

[19]  Christopher R. Wagner,et al.  The Benefit of Force Feedback in Surgery: Examination of Blunt Dissection , 2007, PRESENCE: Teleoperators and Virtual Environments.

[20]  Abdulmotaleb El-Saddik,et al.  Adding haptic feature to YouTube , 2010, ACM Multimedia.

[21]  Abdulmotaleb El-Saddik,et al.  A Fuzzy Logic System for Evaluating Quality of Experience of Haptic-Based Applications , 2008, EuroHaptics.

[22]  Nigel W. John,et al.  The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art , 2011, IEEE Transactions on Haptics.

[23]  R. Mccall,et al.  Fundamental statistics for psychology , 1972 .

[24]  Paul Richard,et al.  Effect of Tactile Feedback and Viewpoint on Task Performance in a Collaborative Virtual Environmment , 2009 .

[25]  Catherine E. Lewis,et al.  Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery , 2009, IEEE Transactions on Haptics.

[26]  Klara Nahrstedt,et al.  Quality of experience in distributed interactive multimedia environments: toward a theoretical framework , 2009, ACM Multimedia.

[27]  U. Andersson,et al.  Effects of tactile training on visual speechreading: performance changes related to individual differences in cognitive skills. , 2001, Journal of deaf studies and deaf education.

[28]  Abdulmotaleb El-Saddik,et al.  A guided tour in haptic audio visual environments and applications , 2007, Int. J. Adv. Media Commun..

[29]  Abdulmotaleb El Saddik,et al.  Effect of haptics on the Quality of Experience , 2010, 2010 IEEE International Symposium on Haptic Audio Visual Environments and Games.

[30]  J Y C Chen,et al.  Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment , 2008, Ergonomics.