Controlling Viewpoint from Markerless Head Tracking in an Immersive Ball Game Using a Commodity Depth Based Camera

We present the use of commodity depth based cameras to control viewpoint from passive unencumbered head tracking. This allowed participants to maintain correct perspective while playing an immersive computer ball game, without the need to wear devices, wires or markers. While viewpoint update is more generally useful than stereoscopy it has traditionally used tracking equipment of expense and complexity unsuitable for home use. The current explosion of depth based cameras into the home game market could provide a cheaper, simpler and more elegant solution. While updating viewpoint from a depth camera has been demonstrated it has not previously been studied in a multi-player or fast moving game or undergone accurate measures of latency, task performance or user experience. We integrated low cost commodity hardware including depth based cameras, computers, projectors and stereo glasses, computer games software, a laptop and large projection surfaces. System latency and user performance and experience were measured across a number of viewpoint conditions. System latency of the viewpoint and hand tracking were measured by analysing high speed video footage. The number of goals scored and saved gave a measure of task performance. Subjective impressions of experience were taken from questionnaire and post interview.

[1]  Frank Ortmeier,et al.  From Discrete Event Simulation to Virtual Reality Environments , 2012, SAFECOMP Workshops.

[2]  Prasant V. Rekapalli,et al.  Discrete-Event Simulation-Based Virtual Reality Environments for Construction Operations: Technology Introduction , 2011 .

[3]  Jeremy R. Cooperstock,et al.  Stereoscopic display technologies, interaction paradigms, and rendering approaches for neurosurgical visualization , 2009, Electronic Imaging.

[4]  Roger J. Brooks,et al.  Experimental investigation of the impacts of virtual reality on discrete-event simulation , 2005, Proceedings of the Winter Simulation Conference, 2005..

[5]  Mark Billinghurst,et al.  The use of sketch maps to measure cognitive maps of virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[6]  Masatoshi Ishikawa,et al.  Ptz control with head tracking for video chat , 2009, CHI Extended Abstracts.

[7]  Robert J. Teather,et al.  Exaggerated head motions for game viewpoint control , 2008, Future Play.

[8]  Thomas B. Sheridan,et al.  Further Musings on the Psychophysics of Presence , 1994, Presence: Teleoperators & Virtual Environments.

[9]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[10]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[11]  Michael Lewis,et al.  Game Engine Virtual Reality with CaveUT , 2005, Computer.

[12]  Christian Geiger,et al.  Creating a virtual archery experience , 2010, AVI.

[13]  Mark R. Mine.  Characterization of End-to-End Delays in Head-Mounted Display Systems , 1993 .

[14]  Chris Harrison,et al.  Pseudo-3D Video Conferencing with a Generic Webcam , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[15]  Steffen Straßburger,et al.  Future trends in distributed simulation and distributed virtual environments: Results of a peer study , 2008, 2008 Winter Simulation Conference.

[16]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[17]  Alon Lerner,et al.  Enhanced interactive gaming by blending full-body tracking and gesture animation , 2010, SA '10.

[18]  Dorian Miller,et al.  Latency meter: a device end-to-end latency of VE systems , 2002, IS&T/SPIE Electronic Imaging.

[19]  Dave Pape,et al.  Video-Based Measurement of System Latency , 2000 .