Virtual Reality as a Tool for the Study of Perception-Action: The Case of Running to Catch Fly Balls

Virtual reality (VR) holds great promise for the study of perception-action. The case of studying the outfielder problem is presented as an example of how VR has contributed to our understanding of perception-action, and of the potential and pitfalls of using VR in such a task. The outfielder problem refers to the situation in a baseball game (and analogous situations) in which an outfielder has to run to get to the right location at the right time to make a catch. Several experimental studies are discussed in which participants had to intercept real or virtual balls. The biggest added value of using VR is the fact that the virtual world is completely in the hands of the experimenter, which allows studying situations that do not exist outside of VR, thus enabling strong hypothesis testing. A number of factors related to the success of the VR experiments are identified, such as the lack of haptic feedback in VR setups used in this paradigm until now, the specifics of the optics presented to the participants, and the available space for locomotion. We argue that it is important to make a close comparison of task behavior in VR with that outside of VR, but conclude having great expectations of the role of VR in perception-action research.

[1]  P. J. Brancazio.  Looking into Chapman’s homer: The physics of judging a fly ball , 1985 .

[2]  Claire F. Michaels,et al.  The optics and actions of catching fly balls , 1992 .

[3]  J T Todd,et al.  Visual information about moving objects. , 1981, Journal of experimental psychology. Human perception and performance.

[4]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[5]  Anne-Marie Brouwer,et al.  Perception of acceleration with short presentation times: Can acceleration be used in interception? , 2001, Perception & psychophysics.

[6]  F. C. Bakker,et al.  The effects of baseball experience on movement initiation in catching fly balls. , 1997, Journal of sports sciences.

[7]  R. Bootsma,et al.  On the information-based regulation of movement: What Wann (1996) may want to consider , 1997 .

[8]  Scott M Krauchunas,et al.  How Dogs Navigate to Catch Frisbees , 2004, Psychological science.

[9]  B. Saxberg,et al.  Projected free fall trajectories , 1987, Biological Cybernetics.

[10]  W. Warren.  Action modes and laws of control for the visual guidance of action , 1988 .

[11]  Seville Chapman.  Catching a Baseball , 1968 .

[12]  R M Wildzunas,et al.  Visual display delay effects on pilot performance. , 1996, Aviation, space, and environmental medicine.

[13]  Dennis M Shaffer,et al.  Baseball outfielders maintain a linear optical trajectory when tracking uncatchable fly balls. , 2002, Journal of experimental psychology. Human perception and performance.

[14]  A. Chardenon,et al.  The perceptual control of goal-directed locomotion: a common control architecture for interception and navigation? , 2004, Experimental Brain Research.

[15]  N Reed,et al.  Toward a unified fielder theory: what we do not yet know about how people run to catch a ball. , 2001, Journal of experimental psychology. Human perception and performance.

[16]  Brett R Fajen,et al.  Reconsidering the role of movement in perceiving action-scaled affordances. , 2011, Human movement science.

[17]  William H Warren,et al.  Catching fly balls in virtual reality: a critical test of the outfielder problem. , 2009, Journal of vision.

[18]  Dennis M Shaffer,et al.  Evidence for a generic interceptive strategy , 2008, Perception & psychophysics.

[19]  F. C. Bakker,et al.  Shedding some light on catching in the dark: perceptual mechanisms for catching fly balls. , 1999, Journal of experimental psychology. Human perception and performance.

[20]  J. Loomis,et al.  Immersive virtual environment technology as a basic research tool in psychology , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[21]  Reinoud J. Bootsma,et al.  Predictive information and the control of action: What you see is what you get. , 1991 .

[22]  Nick Reed,et al.  The optic trajectory is not a lot of use if you want to catch the ball. , 2002, Journal of experimental psychology. Human perception and performance.

[23]  Raoul M Bongers,et al.  The role of eye and head movements in detecting information about fly balls. , 2008, Journal of experimental psychology. Human perception and performance.

[24]  P J Beek,et al.  Catching fly balls: a simulation study of the Chapman strategy. , 2009, Human movement science.

[25]  Laure Fernandez,et al.  Non-linear gaining in precision aiming: making Fitts' task a bit easier. , 2008, Acta psychologica.

[26]  M K Kaiser,et al.  How baseball outfielders determine where to run to catch fly balls. , 1995, Science.

[27]  P. McLeod,et al.  How to Catch a Cricket Ball , 1993, Perception.

[28]  Wildzunas Rm,et al.  Visual display delay effects on pilot performance. , 1996 .

[29]  J. Tresilian.  Study of a Servo-control Strategy for Projectile Interception , 1995 .

[30]  P. McLeod,et al.  Do Fielders Know Where to Go to Catch the Ball or Only How to Get There , 1996 .

[31]  P. McLeod,et al.  The generalized optic acceleration cancellation theory of catching. , 2006, Journal of experimental psychology. Human perception and performance.

[32]  Reinoud J Bootsma.  The (current) future is here! , 2009, Perception.

[33]  Franck Multon,et al.  Using Virtual Reality to Analyze Sports Performance , 2010, IEEE Computer Graphics and Applications.

[34]  B. Saxberg,et al.  Projected free fall trajectories. I. Theory and simulation. , 1987, Biological cybernetics.

[35]  G. M. Gauthier,et al.  Oculo-manual coordination control: Ocular and manual tracking of visual targets with delayed visual feedback of the hand motion , 2004, Experimental Brain Research.

[36]  William H. Warren,et al.  Optic flow is used to control human walking , 2001, Nature Neuroscience.

[37]  R. Miall,et al.  Adaptation to visual feedback delays in manual tracking: evidence against the Smith Predictor model of human visually guided action , 2006, Experimental Brain Research.

[38]  Nigel W. John,et al.  A review of virtual environments for training in ball sports , 2012, Comput. Graph..

[39]  G P Bingham,et al.  Distortions in definite distance and shape perception as measured by reaching without and with haptic feedback. , 2000, Journal of experimental psychology. Human perception and performance.

[40]  Benoît G. Bardy,et al.  Action-perception patterns in virtual ball bouncing: Combating system latency and tracking functional validity , 2008, Journal of Neuroscience Methods.

[41]  B. Saxberg,et al.  Projected free fall trajectories. II. Human experiments. , 1987, Biological cybernetics.

[42]  Javier Ruiz-del-Solar,et al.  Play Ball! , 2010, IEEE Robotics & Automation Magazine.

[43]  W. H. Warren,et al.  Behavioral dynamics of intercepting a moving target , 2007, Experimental Brain Research.

[44]  Ilana Nisky,et al.  Three Alternatives to Measure the Human-Likeness of a Handshake Model in a Turing-like Test , 2012, PRESENCE: Teleoperators and Virtual Environments.

[45]  Geert J P Savelsbergh,et al.  Rate of Change of Angular Bearing as the Relevant Property in a Horizontal Interception Task During Locomotion , 2002, Journal of motor behavior.

[46]  Frank T. J. M. Zaal,et al.  Base on balls for the Chapman strategy: reassessing Brouwer, Brenner, and Smeets (2002) (vol 74, pg 1488, 2012) , 2012 .

[47]  Guillaume Rao,et al.  Judging where a ball will go: the case of curved free kicks in football , 2006, Naturwissenschaften.

[48]  Franck Multon,et al.  Using virtual reality to analyze links between handball thrower kinematics and goalkeeper's reactions , 2004, Neuroscience Letters.

[49]  C. Michaels,et al.  The information for catching fly balls: judging and intercepting virtual balls in a CAVE. , 2003, Journal of experimental psychology. Human perception and performance.

[50]  Nick Reed,et al.  How soccer players head the ball: A test of optic acceleration cancellation theory with virtual reality , 2008, Vision Research.

[51]  G. J. Savelsbergh,et al.  Grasping tau. , 1991, Journal of experimental psychology. Human perception and performance.

[52]  G. Montagne,et al.  A Robust Solution for Dealing With Environmental Changes in Intercepting Moving Balls , 2005, Journal of motor behavior.