Augmented HE-Book: A Multimedia Based Extension to Support Immersive Reading Experience

Traditionally we know that the use of various modalities such as audio-visual materials can influence the effective learning behaviour [6]. Can haptic rendering if combined with the audio-visual learning content have the similar effect? In order to examine that we present an intuitive approach of annotation based hapto-audio-visual interaction with the traditional digital learning materials such as eBooks. It leverages the haptic jacket interface to receive haptic emotive signals wirelessly in the form of patterned vibrations of the actuators and expresses the learning material by incorporating image based augmented display in order to pave ways for intimate reading experience in the popular eBook platform.

[1]  Anselmo Lastra,et al.  Immersive electronic books for surgical training , 2005, IEEE MultiMedia.

[2]  Anne Mangen,et al.  Hypertext fiction reading: haptics and immersion , 2008 .

[3]  Taezoon Park,et al.  Facilitating the Design of Vibration for Handheld Devices , 2009, HCI.

[4]  Julie A. Jacko.  Novel interaction methods and techniques , 2009 .

[5]  Ed Huai-hsin Chi,et al.  Annotating 3D electronic books , 2005, CHI EA '05.

[6]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[7]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[8]  Jock D. Mackinlay,et al.  3Book: a scalable 3D virtual book , 2004, CHI EA '04.

[9]  村田 和義,et al.  HCI International 2009 , 2009, Universal Access in the Information Society.

[10]  Christopher O. Jaynes,et al.  The universal media book: tracking and augmenting moving surfaces with projected information , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[11]  Catherine C. Marshall,et al.  As We May Read The Reading Appliance Revolution , 1999 .

[12]  E. Dale.  Audio-visual methods in teaching , 1946 .

[13]  B. L. Harrison,et al.  E-books and the future of reading , 2000 .

[14]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[15]  Nicholas Chen,et al.  Navigation techniques for dual-display e-book readers , 2008, CHI.

[16]  Mark Billinghurst,et al.  The design of a mixed-reality book: Is it still a real book? , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[17]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[18]  Abu Saleh Md. Mahfujur Rahman,et al.  Authoring edutainment content through video annotations and 3D model augmentation , 2009, 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems.

[19]  Abdulmotaleb El Saddik,et al.  Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[20]  Abu Saleh Md. Mahfujur Rahman,et al.  Bridging the Gap between Virtual and Real World by Bringing an Interpersonal Haptic Communication System in Second Life , 2010, 2010 IEEE International Symposium on Multimedia.