Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments

In order to leverage the use of various modalities such as audio-visual materials in instilling effective learning behavior we present an intuitive approach of annotation based hapto-audio-visual interaction with the traditional digital learning materials such as e-books. By integrating the home entertainment system in the user's reading experience combined with haptic interfaces we want to examine whether such augmentation of modalities influence the user's learning patterns. The proposed Haptic E--Book (HE-Book) system leverages the haptic jacket, haptic arm band as well as haptic sofa interfaces to receive haptic emotive signals wirelessly in the form of patterned vibrations of the actuators and expresses the learning material by incorporating image, video, 3D environment based augmented display in order to pave ways for intimate reading experience in the popular mobile e-book platform.

[1]  A. El Saddik,et al.  EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion , 2012, 2012 International Conference on Innovations in Information Technology (IIT).

[2]  B. L. Harrison,et al.  E-books and the future of reading , 2000 .

[3]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[4]  Mark Billinghurst,et al.  The design of a mixed-reality book: Is it still a real book? , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[5]  SaddikAbdulmotaleb El,et al.  Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments , 2013 .

[6]  Shogo Nishida,et al.  Virtual Pop-Up Book Based on Augmented Reality , 2007, HCI.

[7]  Catherine C. Marshall,et al.  As We May Read The Reading Appliance Revolution , 1999 .

[8]  D. Leutner,et al.  Direct Measurement of Cognitive Load in Multimedia Learning , 2003 .

[9]  Christopher D. Manning,et al.  Enriching the Knowledge Sources Used in a Maximum Entropy Part-of-Speech Tagger , 2000, EMNLP.

[10]  Christopher O. Jaynes,et al.  The universal media book: tracking and augmenting moving surfaces with projected information , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[11]  Newton Lee,et al.  ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMCCAP) , 2007, CIE.

[12]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[13]  Abdulmotaleb El Saddik,et al.  Adding emotional tag to augment context-awareness in social network services , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[14]  Abu Saleh Md. Mahfujur Rahman,et al.  Bridging the Gap between Virtual and Real World by Bringing an Interpersonal Haptic Communication System in Second Life , 2010, 2010 IEEE International Symposium on Multimedia.

[15]  Taezoon Park,et al.  Facilitating the Design of Vibration for Handheld Devices , 2009, HCI.

[16]  Russell N. Carney,et al.  Pictorial Illustrations Still Improve Students' Learning from Text , 2002 .

[17]  Paul W. F. Witt.  Audio-visual methods in teaching , 1954 .

[18]  Nicholas Chen,et al.  Navigation techniques for dual-display e-book readers , 2008, CHI.

[19]  Abdulmotaleb El Saddik,et al.  Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[20]  Woontack Woo,et al.  Multi-layer Based Authoring Tool for Digilog Book , 2009, ICEC.

[21]  Yutaka Ishibashi,et al.  Perception of synchronization errors in haptic and visual communications , 2006, SPIE Optics East.

[22]  Anselmo Lastra,et al.  Immersive electronic books for surgical training , 2005, IEEE MultiMedia.

[23]  Anne Mangen,et al.  Hypertext fiction reading: haptics and immersion , 2008 .

[24]  Jock D. Mackinlay,et al.  3Book: a scalable 3D virtual book , 2004, CHI EA '04.

[25]  Ed Huai-hsin Chi,et al.  Annotating 3D electronic books , 2005, CHI EA '05.

[26]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[27]  Abu Saleh Md. Mahfujur Rahman,et al.  Augmented HE-Book: A Multimedia Based Extension to Support Immersive Reading Experience , 2011, AIS.

[28]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[29]  Abdulmotaleb El-Saddik,et al.  Continuous tactile perception for vibrotactile displays , 2009, 2009 IEEE International Workshop on Robotic and Sensors Environments.

[30]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[31]  Abu Saleh Md. Mahfujur Rahman,et al.  HE-book: A prototype haptic interface for immersive e-book reading experience , 2011, 2011 IEEE World Haptics Conference.

[32]  Ronald P. Carver,et al.  Reading Rate: Theory, Research, and Practical Implications. , 1992 .

[33]  Federico Casalegno,et al.  The Three Dimensions of Book Evolution in Ubiquitous Computing Age: Digitalization, Augmentation, and Hypermediation , 2010, 2010 IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing.

[34]  Paul Lemmens,et al.  A body-conforming tactile jacket to enrich movie viewing , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.