HCI over multiple screens

Mobile devices are playing an increasingly important role in leisure activities, including TV viewing. Broadcasters see this as an opportunity to enhance a TV programme through the provision of additional information to the 'second screen', but determining how to optimise this experience is one of the grand challenges currently facing content providers. Addressing this issue requires a detailed understanding of interaction with both the TV and the secondary device, but this new form of HCI, as much about passive consumption as active interaction, is not well represented by typical task-based paradigms. This paper describes experiments that use eye tracking to understand one of the key components of this new area of study - determining which device is currently receiving the user's attention - and discusses the considerable challenge of accurately monitoring attention while maintaining ecological validity.

[1]  Stacey D. Scott,et al.  Collaborative sensemaking on a digital tabletop and personal tablets: prioritization, comparisons, and tableaux , 2013, CHI.

[2]  Christopher Howson,et al.  Second screen TV synchronization , 2011, 2011 IEEE International Conference on Consumer Electronics -Berlin (ICCE-Berlin).

[3]  Anthony J. Hornof,et al.  Knowing where and when to look in a time-critical multimodal dual task , 2010, CHI.

[4]  Nicholas Chen,et al.  Graduate student use of a multi-slate reading system , 2013, CHI.

[5]  Michael Evans,et al.  Exploring and enhancing the user experience for TV , 2013, CHI Extended Abstracts.

[6]  Janet H. Murray,et al.  Story-map: iPad companion for long form TV narratives , 2012, EuroITV.

[7]  Konstantinos Chorianopoulos,et al.  User Interface Design Principles for Interactive Television Applications , 2008, Int. J. Hum. Comput. Interact..

[8]  Jakob E. Bardram,et al.  ReticularSpaces: activity-based computing support for physically distributed and collaborative smart spaces , 2012, CHI.

[9]  Dugald Hutchings.  An investigation of Fitts' law in a multiple-display environment , 2012, CHI.

[10]  Craig Hennessey,et al.  Long range eye tracking: bringing eye tracking into the living room , 2012, ETRA.

[11]  Regina Bernhaupt,et al.  Measuring user experience in the living room: results from an ethnographically oriented field study indicating major evaluation factors , 2011, EuroITV '11.

[12]  Ravin Balakrishnan,et al.  Codex: a dual screen tablet computer , 2009, CHI.

[13]  Michael E. Holmes,et al.  Visual attention to television programs with a second-screen application , 2012, ETRA '12.

[14]  Crysta J. Metcalf,et al.  Field trial of a dual device user experience for iTV , 2011, EuroITV '11.

[15]  Leon Cruickshank,et al.  Making Interactive tv Easier to Use: Interface Design for a Second Screen Approach , 2007 .

[16]  Pedro Centieiro,et al.  Bringing the sport stadium atmosphere to remote fans , 2013, ACM Multimedia.

[17]  David Geerts,et al.  Second-Screen Use in the Home: an Ethnographic Study , 2012 .

[18]  Albrecht Schmidt,et al.  Gazemarks: gaze-based visual placeholders to ease attention switching , 2010, CHI.

[19]  Michael Evans,et al.  Researching the user experience for connected tv: a case study , 2012, CHI EA '12.

[20]  Andreas Butz,et al.  How screen transitions influence touch and pointer interaction across angled display arrangements , 2012, CHI.

[21]  Christopher Howson,et al.  Fast second screen TV synchronization combining audio fingerprint technique and generalized cross correlation , 2012, 2012 IEEE Second International Conference on Consumer Electronics - Berlin (ICCE-Berlin).