Companion apps for information-rich television programmes: representation and interaction

The use of a companion app to augment viewing of information-rich television programmes is investigated. The app displays a synchronised graphical abstraction of a programme’s content in the form of a concept map. Two experiments were conducted involving participants watching an astronomy documentary with the app. The first compared watching the programme with and without the app, and the second compared non-interactive and interactive versions of the app. Understanding of the programme, cross-device gaze behaviour, and user experience of the app were assessed. Our results show that the companion app improved participants’ understanding and recall of the programme. Participants were found to manage their visual attention systematically when using the companion app, and correlations were found in the way they shifted their gaze from TV screen to tablet and back in response to changes in the programme content. Increasing interaction with the app disrupted understanding of the television programme and visual attention. Participants were positive about the value of companion apps for understanding and recall of programmes, but distraction and ‘knowing where to look’ were significant concerns.

[1]  Jan van Dijk,et al.  Searching for the Holy Grail: Images of Interactive Television , 2001, New Media Soc..

[2]  Michael Evans,et al.  Mediating Attention for Second Screen Companion Content , 2015, CHI.

[3]  Radu-Daniel Vatavu,et al.  Visual attention measures for multi-screen TV , 2014, TVX '14.

[4]  Evelien D'heer,et al.  Second screen applications and tablet users: constellation, awareness, experience, and interest , 2012, EuroITV.

[5]  David M. Grayson,et al.  Sharable digital TV: relating ethnography to design through un-useless product suggestions , 2006, CHI EA '06.

[6]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[7]  Paul Coulton,et al.  Sharing the viewing experience through second screens , 2012, EuroITV.

[8]  Andy Brown,et al.  HCI over multiple screens , 2014, CHI Extended Abstracts.

[9]  J. Novak.  Concept mapping: A useful tool for science education , 1990 .

[10]  Daniel R. Anderson,et al.  Attentional Inertia and Recognition Memory in Adult Television Viewing , 1993 .

[11]  Donald F. Dansereau,et al.  The Effect of Animated Node-Link Displays on Information Recall , 2000 .

[12]  Linda F. Alwitt,et al.  Watching Children Watch Television , 1979 .

[13]  Duncan Rowland,et al.  Who is on your sofa?: TV audience communities and second screening social networks , 2012, EuroITV.

[14]  John C. Nesbit,et al.  Learning from Animated Concept Maps with Concurrent Audio Narration , 2011 .

[15]  R. Zatorre,et al.  Voice-selective areas in human auditory cortex , 2000, Nature.

[16]  Crysta J. Metcalf,et al.  FANFEEDS: evaluation of socially generated information feed on second screen as a TV show companion , 2012, EuroITV.

[17]  Robert P. Hawkins,et al.  What produces television attention and attention style? Genre, situation, and individual differences as predictors , 2005 .

[18]  Leon Cruickshank,et al.  Making Interactive tv Easier to Use: Interface Design for a Second Screen Approach , 2007 .

[19]  Marita Franzke,et al.  Dual device user interface design: PDAs and interactive television , 1996, CHI.

[20]  Olusola O. Adesope,et al.  Learning With Concept and Knowledge Maps: A Meta-Analysis , 2006 .

[21]  Janet H. Murray,et al.  Companion apps for long arc TV series: supporting new viewers in complex storyworlds with tightly synchronized context-sensitive annotations , 2014, TVX '14.

[22]  Janet H. Murray,et al.  Story-map: iPad companion for long form TV narratives , 2012, EuroITV.

[23]  L. Zarsky,et al.  Searching for the Holy Grail , 2003 .

[24]  Pablo César,et al.  Usages of the Secondary Screen in an Interactive Television Environment: Control, Enrich, Share, and Transfer Television Content , 2008, EuroITV.

[25]  Michael E. Holmes,et al.  Visual attention to television programs with a second-screen application , 2012, ETRA '12.

[26]  John C. Nesbit,et al.  Animated and static concept maps enhance learning from spoken narration , 2013 .

[27]  David Geerts,et al.  In front of and behind the second screen: viewer and producer perspectives on a companion app , 2014, TVX '14.

[28]  Robert P. Hawkins,et al.  Strategy and style in attention to television , 1997 .

[29]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[30]  M. Basil.  Multiple Resource Theory I , 1994 .

[31]  Crysta J. Metcalf,et al.  Field trial of a dual device user experience for iTV , 2011, EuroITV '11.

[32]  Lyn Pemberton,et al.  Dual device user interface design for ubiquitous language learning: mobile phone and interactive television (iTV) , 2005, IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE'05).