Thinking Through the Box: Evaluating a 3D Game to Engage Penetrative Thinking

Spatial skills allow us to mentally imagine and manipulate objects and their spatial relations. These skills are crucial in both every day and expert tasks. The present paper reports on an evaluation of a 3D game developed to train a specific spatial skill known as penetrative thinking—the ability to imagine cross-sections of 3D objects from their surface features. In the game, users change the location and orientation of a virtual plane to make cuts through 3D objects in a series of spatial puzzles. Users operate an interface to position the virtual plane until a “slice” at the location of the plane matches a target cross-section of a virtual object. Multiple spatial puzzles with different properties are completed throughout the game. In one version of the game, users completed the puzzles in an immersive virtual environment and operated a tangible interface to move the virtual plane. A secondary version of the game required users to view the puzzles in a virtual environment displayed on a computer screen, and to position the slicing plane with a keyboard and mouse. Participants (n = 45) completed a measure of penetrative thinking (Santa Barbara Solids Test) before and after completing one of three interventions: the game with the tangible interface (n = 15), the game with the keyboard interface (n = 15), or a series of (control) questions (n = 15). Although there were no significant pre-/post-intervention changes in penetrative thinking in any of the groups, participants' performance in the game correlated with scores on a standardized test of penetrative thinking. These results provide evidence that the game and the standardized test accessed similar spatial skills and, as a consequence, indicate that the 3D game has the potential to be a valid approach for training penetrative thinking skills.

[1]  Kathy Hirsh-Pasek,et al.  Understanding spatial transformations: similarities and differences between mental rotation and mental folding , 2013, Cognitive Processing.

[2]  Wai-Tat Fu,et al.  Supporting Spatial Skill Learning with Gesture-Based Embodied Design , 2018, IUI.

[3]  W. Prinz Perception and Action Planning , 1997 .

[4]  Laura Malinverni,et al.  Experience as an Object to Think with: from Sensing-in-action to Making-Sense of action in Full-Body Interaction Learning Environments , 2016, TEI.

[5]  Yasuto Nakanishi,et al.  Virtual prototyping using miniature model and visualization for interactive public displays , 2012, DIS '12.

[6]  D. Cheung The key factors affecting students’ individual interest in school science lessons , 2018 .

[7]  Jun Wang,et al.  A Critical Review of the Use of Virtual Reality in Construction Engineering Education and Training , 2018, International journal of environmental research and public health.

[8]  K. Hannula Do geology field courses improve penetrative thinking? , 2019, Journal of Geoscience Education.

[9]  Asim Evren Yantaç,et al.  A review on complementary natures of tangible user interfaces (TUIs) and early spatial learning , 2018, Int. J. Child Comput. Interact..

[10]  Paul Clifton,et al.  TASC: Combining Virtual Reality with Tangible and Embodied Interactions to Support Spatial Cognition , 2017, Conference on Designing Interactive Systems.

[11]  Bernhard E. Riecke,et al.  Bridging the gap: attribute and spatial metaphors for tangible interface design , 2012, TEI.

[12]  Diana Bairaktarova,et al.  A Cognitive Approach to Spatial Visualization Assessment for First-Year Engineering Students. , 2018 .

[13]  A. Wohlschläger Mental object rotation and the planning of hand movements , 2001, Perception & psychophysics.

[14]  N. Newcombe,et al.  Picturing perspectives: development of perspective-taking abilities in 4- to 8-year-olds , 2014, Frontiers in Psychology.

[15]  M. Hegarty,et al.  Sources of Difficulty in Imagining Cross Sections of 3D Objects , 2007 .

[16]  Paul Clifton,et al.  Evaluating the effect of tangible virtual reality on spatial perspective taking ability , 2017, SUI.

[17]  Susan Goldin-Meadow,et al.  Action’s Influence on Thought: The Case of Gesture , 2010, Perspectives on psychological science : a journal of the Association for Psychological Science.

[18]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  Andreas Dünser,et al.  Virtual and augmented reality as spatial ability training tools , 2006, CHINZ '06.

[20]  T. Shipley,et al.  Student Gestures Aid Penetrative Thinking , 2015 .

[21]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[22]  Bruce Wainman,et al.  The superiority of three‐dimensional physical models to two‐dimensional computer presentations in anatomy learning , 2018, Medical education.

[23]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[24]  G. Norman,et al.  Virtual reality and brain anatomy: a randomised trial of e‐learning instructional designs , 2007, Medical education.

[25]  Daniel Mendes,et al.  VRRRRoom: Virtual Reality for Radiologists in the Reading Room , 2017, CHI.

[26]  D. Lubinski,et al.  Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. , 2009 .

[27]  Paul Dourish,et al.  Where the action is , 2001 .

[28]  Ali Mazalek,et al.  Keep the Ball Rolling: Designing Game-Based Tangible VR for Spatial Penetrative Thinking Ability , 2019, Conference on Designing Interactive Systems.

[29]  Rainer Malaka,et al.  VRBox: A Virtual Reality Augmented Sandbox for Immersive Playfulness, Creativity and Exploration , 2018, CHI PLAY.

[30]  S. Vandenberg,et al.  Mental Rotations, a Group Test of Three-Dimensional Spatial Visualization , 1978, Perceptual and motor skills.

[31]  D. Uttal,et al.  Spatial Thinking and STEM Education. When, Why, and How? , 2012 .

[32]  M. Y. Small,et al.  Research in College Science Teaching: Spatial Visualization Training Improves Performance in Organic Chemistry. , 1983 .

[33]  Caecilia Charbonnier,et al.  Real virtuality: a multi-user immersive platform connecting real and virtual worlds , 2016, VRIC.

[34]  Wai-Tat Fu,et al.  Untangling the Relationship Between Spatial Skills, Game Features, and Gender in a Video Game , 2017, IUI.

[35]  Alissa Nicole Antle,et al.  Comparing motor-cognitive strategies for spatial problem solving with tangible and multi-touch interfaces , 2013, TEI '13.

[36]  M. Schlossberg An International Directory of Spatial Tests. , 1984 .

[37]  D. Lubinski,et al.  Study of Mathematically Precocious Youth After 35 Years: Uncovering Antecedents for the Development of Math-Science Expertise , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[38]  Carol J. Ormand,et al.  Improving spatial thinking skills among undergraduate geology students through short online training exercises , 2018, International Journal of Science Education.

[39]  Carol J. Ormand,et al.  Evaluating Geoscience Students' Spatial Thinking Skills in a Multi-Institutional Classroom Study , 2014 .

[40]  Ali Mazalek,et al.  A Tangible VR Game Designed for Spatial Penetrative Thinking Ability , 2018, CHI Extended Abstracts.

[41]  Paul Clifton,et al.  I'm in the game: embodied puppet interface improves avatar control , 2010, TEI.

[42]  Timothy R. B. Taylor,et al.  Effectiveness of communication of spatial engineering information through 3D CAD and 3D printed models , 2014 .

[43]  Evren Bozgeyikli,et al.  Tangiball: Dynamic Embodied Tangible Interaction with a Ball in Virtual Reality , 2019, Conference on Designing Interactive Systems.

[44]  Martin Buschkuehl,et al.  Support of mathematical thinking through embodied cognition: Nondigital and digital approaches , 2017, Cognitive Research: Principles and Implications.

[45]  Cindy Grimm,et al.  Inferring cross-sections of 3D objects: a 3D spatial ability test instrument for 3D volume segmentation , 2017, SAP.

[46]  Jörn Hurtienne,et al.  The Impact of Tangible Props on Gaming Performance and Experience in Gestural Interaction , 2018, Tangible and Embedded Interaction.

[47]  Marc Erich Latoschik,et al.  Usability of Gamified Knowledge Learning in VR and Desktop-3D , 2019, CHI.

[48]  M. Hegarty,et al.  Inferring cross sections of 3D objects: A new spatial thinking test , 2012 .

[49]  B. Laeng,et al.  A Redrawn Vandenberg and Kuse Mental Rotations Test - Different Versions and Factors That Affect Performance , 1995, Brain and Cognition.

[50]  M. Hegarty,et al.  A dissociation between object manipulation spatial ability and spatial orientation ability , 2001, Memory & cognition.

[51]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[52]  Yael Kali,et al.  Spatial abilities of high‐school students in the perception of geologic structures , 1996 .

[53]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.