A Heuristic Checklist for Second Screen Applications

Abstract This paper presents domain-specific heuristics for second screen applications and the development of a heuristics checklist to enable a more intuitive and structured application of the created heuristics. The heuristics presented were developed on the basis of Nielsen [12] Ten Usability Heuristics in a research-based approach using specific literature and a focus group. In order to evaluate the quality of the derived checklist, a heuristic evaluation of a second screen application with five users was carried out and its results compared to a user study with 20 participants. This resulted in an average validity of 0.5 and a high completeness of 0.74. The harmonic mean of these values results in an F-measure of 0.6 with an equal weighting. This value speaks for a sufficient validity of the created heuristic checklist in the first iteration.

[1]  Birgit Stark,et al.  Wenn der Fernseher nicht mehr ausreicht: Eine empirische Analyse der Second Screen-Nutzung When watching television becomes insufficient: An empirical analysis of second screen usage , 2015 .

[2]  Luciana Porcher Nedel,et al.  Guidelines for Designing Dynamic Applications with Second Screen , 2015, 2015 XVII Symposium on Virtual and Augmented Reality.

[3]  Vicente Moret-Bonillo,et al.  Usability evaluation and development of heuristics for second-screen applications , 2017, SAC.

[4]  G. Salvendy,et al.  Extension of heuristic evaluation method: a review and reappraisal , 2005 .

[5]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[6]  Valéria Farinazzo Martins Salvador,et al.  A Checklist to Evaluate Augmented Reality Applications , 2014, SVR.

[7]  Ebba Þóra Hvannberg,et al.  Heuristic evaluation: Comparing ways of finding and reporting usability problems , 2007, Interact. Comput..

[8]  Robert C. Williges,et al.  Criteria For Evaluating Usability Evaluation Methods , 2003, Int. J. Hum. Comput. Interact..

[9]  Andrew Sears,et al.  Heuristic Walkthroughs: Finding the Problems Without the Noise , 1997, Int. J. Hum. Comput. Interact..

[10]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[11]  Christian Wolff,et al.  Heuristiken für Information Appliances , 2014, Mensch & Computer.

[12]  Jonathan Weinel,et al.  Second screen comes to the silver screen: A technology feasibility study regarding mobile technologies in the cinema , 2015, 2015 Internet Technologies and Applications (ITA).

[13]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[14]  Virginica Rusu,et al.  A Methodology to Establish Usability Heuristics , 2011, ACHI 2011.