Physical games or digital games?: comparing support for mental projection in tangible and virtual representations of a problem-solving task

This paper explores how different interfaces to a problem-solving task affect how users perform it. Specifically, it focuses on a customized version of the game of Four-in-a-row and compares play on a physical, tangible game board with that conducted in mouse and touch-screen driven virtual versions. This is achieved through a repeated measures study involving a total of 36 participants and which explicitly assesses aspects of cognitive work through measures of time task, subjective workload, the projection of mental constructs onto external structures and the occurrence of explanatory epistemic actions. The results highlight the relevance of projection and epistemic action to this problem-solving task and suggest that the different interface forms afford instantiation of these activities in different ways. The tangible version of the system supports the most rapid execution of these actions and future work on this topic should explore the unique advantages of tangible interfaces in supporting epistemic actions.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  Alissa Nicole Antle,et al.  The CTI framework: informing the design of tangible systems for children , 2007, TEI.

[3]  Hiroshi Ishii,et al.  A comparison of spatial organization strategies in graphical and tangible user interfaces , 2000, DARE '00.

[4]  Frédéric Vallée-Tourangeau,et al.  Interactive insight problem solving , 2011 .

[5]  Elise van den Hoven,et al.  Framing tangible interaction frameworks , 2009, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[6]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[7]  Jiajie Zhang,et al.  The Nature of External Representations in Problem Solving , 1997, Cogn. Sci..

[8]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[9]  D. Kirsh.  Problem Solving and Situated Cognition , 2009 .

[10]  Mark Billinghurst,et al.  Designing augmented reality interfaces , 2005, COMG.

[11]  Alissa Nicole Antle,et al.  Exploring how children use their hands to think: an embodied interactional analysis , 2013, Behav. Inf. Technol..

[12]  Abigail Sellen,et al.  Putting the physical into the digital: issues in designing hybrid interactive surfaces , 2009 .

[13]  F. Vallée-Tourangeau,et al.  The impact of external representation in a rule discovery task , 2005 .

[14]  William W. Gaver.  Technology affordances , 1991, CHI.

[15]  Paul Marshall,et al.  Editorial: the evolving field of tangible interaction for children: the challenge of empirical validation , 2012, Personal and Ubiquitous Computing.

[16]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[17]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[18]  David Kirsh,et al.  Projection, Problem Space and Anchoring , 2009 .

[19]  Eva Hornecker,et al.  Beyond affordance: tangibles' hybrid nature , 2012, TEI.

[20]  Jakob Tholander,et al.  Towards a new set of ideals: consequences of the practice turn in tangible interaction , 2008, TEI.

[21]  Roy Want,et al.  Embodied user interfaces for really direct manipulation , 2000, CACM.

[22]  Hiroshi Ishii,et al.  ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation , 2011, UIST.

[23]  Michael L. Anderson.  Embodied Cognition: A field guide , 2003, Artif. Intell..

[24]  Panos Markopoulos,et al.  Evaluating outdoor play for children: virtual vs. tangible game objects in pervasive games , 2009, IDC.

[25]  Rosemary Luckin,et al.  Tangibles in the balance: a discovery learning task with physical or graphical materials , 2010, TEI '10.

[26]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[27]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[28]  Hiroshi Ishii,et al.  A tangible interface for organizing information using a grid , 2002, CHI.