A prototype Haptic E-Book system to support immersive remote reading in a smart space

Interactive book reading contributes profoundly to the language development in preschool students. Experimental research showed that shared book-reading between adults and children provides children with the opportunity to acquire new vocabulary. Moreover, the time spent reading together provides clear evidence to a child of a parent's love and care [1]. Inspired by such, we propose a remote reading framework in which parents or grandparents remotely participate in remote reading sessions. In this framework, we present an intuitive annotation based approach of hapto-audio-visual interaction with the traditional digital learning materials. We argue that picture and haptic modality enhanced book reading accelerates language development as students can relate the text with a known visual and tactile references. Hence, in the proposed Haptic E-Book system, by integrating the home entertainment system in the user's reading experience combined with haptic interfaces we examine whether such augmentation of modalities influence the user's learning behaviour. The proposed Haptic E-Book (HE-Book) system leverages the haptic jacket, haptic arm band as well as haptic sofa interfaces to provide haptic emotive signals to the remote story listener in the form of patterned vibrations of the actuators and expresses the learning material by incorporating image based augmented display in order to pave ways for intimate, shared, and immersive reading experience in the popular ebook platform.

[1]  Ivan Poupyrev,et al.  MagicBook: transitioning between reality and virtuality , 2001, CHI Extended Abstracts.

[2]  N. Gardner,et al.  Expressive One-Word Picture Vocabulary Test , 1981 .

[3]  M. Fox Reading Magic: Why Reading Aloud to Our Children Will Change Their Lives Forever , 2001 .

[4]  E. Dale Audio-visual methods in teaching , 1946 .

[5]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[6]  J. Arena,et al.  Expressive one-word picture vocabulary test , 1984 .

[7]  Monique Sénéchal,et al.  A book reading intervention with preschool children who have limited vocabularies: the benefits of regular reading and dialogic reading , 2000 .

[8]  Abu Saleh Md. Mahfujur Rahman,et al.  Bridging the Gap between Virtual and Real World by Bringing an Interpersonal Haptic Communication System in Second Life , 2010, 2010 IEEE International Symposium on Multimedia.

[9]  Abu Saleh Md. Mahfujur Rahman,et al.  HKiss: Real world based haptic interaction with virtual 3D avatars , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[10]  Catherine C. Marshall,et al.  As We May Read The Reading Appliance Revolution , 1999 .

[11]  Abu Saleh Md. Mahfujur Rahman,et al.  Authoring edutainment content through video annotations and 3D model augmentation , 2009, 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems.

[12]  Hengameh Kermani,et al.  Caregivers' Story Reading to Young Children in Family Literacy Programs: Pleasure or Punishment?. , 2001 .

[13]  Christopher J. Lonigan,et al.  Relative efficacy of parent and teacher involvement in a shared-reading intervention for preschool children from low-income backgrounds , 1998 .

[14]  Jonathan M. Campbell,et al.  Peabody Picture Vocabulary Test , 2010 .

[15]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[16]  Abu Saleh Md. Mahfujur Rahman,et al.  Augmented HE-Book: A Multimedia Based Extension to Support Immersive Reading Experience , 2011, AIS.

[17]  Abu Saleh Md. Mahfujur Rahman,et al.  KissMe: Bringing virtual events to the real world , 2008, 2008 IEEE Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems.

[18]  W. Marsden I and J , 2012 .

[19]  J. E. Stone,et al.  Peabody Picture Vocabulary Test-Revised (PPVT–R) , 1989, Diagnostique.

[20]  Anne Mangen,et al.  Hypertext fiction reading: haptics and immersion , 2008 .

[21]  Christopher J. Lonigan,et al.  Accelerating language development through picture book reading: replication and extension to a videotape training format , 1994 .