SmartRSVP: Facilitating Attentive Speed Reading on Small Screen Wearable Devices

Smart watches can enrich everyday interactions by providing both glanceable information and instant access to frequent tasks. However, reading text messages on a 1.5-inch screen is inherently challenging, especially when a user's attention is divided. We present SmartRSVP, an attentive speed-reading system to facilitate text reading on small screen wearable devices. SmartRSVP leverages camera-based visual attention tracking as a play/pause control channel, and uses implicit physiological signal sensing to adjust speed in real-time to make text reading via Rapid Serial Visual Presentation (RSVP) more enjoyable and practical on smart watches. Through two pilot studies, we received positive feedback on the visual attention controlling feature and confirmed the feasibility of the speed adjusting feature of SmartRSVP. This paper reports the preliminary results of the studies.

[1]  John L. Sibert,et al.  Heart rate variability: indicator of user state as an aid to human-computer interaction , 1998, CHI.

[2]  Daniel Afergan,et al.  Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State , 2016, CHI.

[3]  Xiang 'Anthony' Chen,et al.  Duet: exploring joint interactions on a smart phone and a smart watch , 2014, CHI.

[4]  Jian Sun,et al.  Face Alignment at 3000 FPS via Regressing Local Binary Features , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Tobias Höllerer,et al.  Spatio-Temporal Detection of Divided Attention in Reading Applications Using EEG and Eye Tracking , 2015, IUI.

[6]  Steven K. Feiner,et al.  Gaze locking: passive eye contact detection for human-object interaction , 2013, UIST.

[7]  D. Cavouras,et al.  A Simple algorithm to monitor HR for real time treatment applications , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[8]  Amy Ogan,et al.  ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices , 2013, CHI.

[9]  Chris Harrison,et al.  Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices , 2009, UIST '09.

[10]  Monica S. Castelhano,et al.  Optimizing the reading of electronic text using rapid serial visual presentation , 2001, Behav. Inf. Technol..

[11]  John Paulin Hansen,et al.  A gaze interactive textual smartwatch interface , 2015, UbiComp/ISWC Adjunct.

[12]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[13]  P. David Pearson,et al.  Synthesis of Research / Reading Comprehension: What Works To set the stage for students to succeed at reading, teachers can supply ample time for text reading, direct strategy instruction, and opportunities for collaboration and discussion. , 1994 .

[14]  John F. Canny,et al.  Balancing Accuracy and Fun: Designing Camera Based Mobile Games for Implicit Heart Rate Monitoring , 2015, CHI.

[15]  Pietro Perona,et al.  Cascaded pose regression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Claude Frasson,et al.  A dynamic multimodal approach for assessing learners' interaction experience , 2013, ICMI '13.

[17]  Marc Brysbaert,et al.  Visual constraints in written word recognition: evidence from the optimal viewing-position effect , 2005 .

[18]  Kent Lyons,et al.  The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[19]  Roel Vertegaal,et al.  eyeLook: using attention to facilitate mobile media consumption , 2005, UIST '05.

[20]  Xiang 'Anthony' Chen,et al.  Swipeboard: a text entry technique for ultra-small interfaces that supports novice to expert transitions , 2014, UIST.

[21]  Shwetak N. Patel,et al.  SwitchBack: Using Focus and Saccade Tracking to Guide Users' Attention for Mobile Task Resumption , 2015, CHI.

[22]  N. Kanwisher.  Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[23]  Niels Henze,et al.  RSVP on the go: implicit reading support on smart watches through eye tracking , 2016, SEMWEB.