Is a Time-Of-Flight Camera Better than a Mouse for 3D Direct Selection in Virtual Worlds?

We present an empirical study on direct selection tasks in virtual environment (VE). The aim is to assess the interest of a new markerless hand tracking system, based on a time-of-flight 3D camera, on a classical mouse, by comparing performances and subjective judgments relatively to utility, usability and immersion. Performances were similar with our system, compared to the mouse, but the perceived usefulness and immersion were judged better. Our system remains lower than the mouse in terms of efficiency and satisfaction. The study reported here, through a simple selection task, demonstrates the interest of this type of camera for real time motion capture. This contribution is a first step and we have to further study more complex task like navigation in virtual environments and object manipulation (moving, scaling, and orientation).

[1]  M. Lempereur,et al.  Simulation du mouvement d'entrée dans un véhicule automobile , 2006 .

[2]  Björn Stenger,et al.  Template-Based Hand Pose Recognition Using Multiple Cues , 2006, ACCV.

[3]  Nirbhay N. Singh,et al.  Microswitch and keyboard-emulator technology to facilitate the writing performance of persons with extensive motor disabilities. , 2011, Research in developmental disabilities.

[4]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[5]  Olivier D. Faugeras,et al.  3D articulated models and multi-view tracking with silhouettes , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Dominique L. Scapin,et al.  Ergonomic criteria adapted to human virtual environment interaction , 2003, IHM '03.

[7]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Luigi di Stefano,et al.  A fast area-based stereo matching algorithm , 2004, Image Vis. Comput..

[9]  Simon Richir,et al.  E-commerce and web 3D for involving the customer in the design process: the case of a gates 3D configurator , 2012, VRIC.

[10]  Chris Hand,et al.  A Survey of 3D Interaction Techniques , 1997, Comput. Graph. Forum.

[11]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[12]  J. Fischer,et al.  The Prehensile Movements of the Human Hand , 2014 .

[13]  Douglas A. Bowman,et al.  Interaction Techniques For Common Tasks In Immersive Virtual Environments - Design, Evaluation, And , 1999 .

[14]  Michel Beaudouin-Lafon,et al.  Designing interaction, not interfaces , 2004, AVI.

[15]  D Thalmann,et al.  Using skeleton-based tracking to increase the reliability of optical motion capture. , 2001, Human movement science.

[16]  Ikuo Mizuuchi,et al.  A Musculoskeletal Flexible-Spine Humanoid Kotaro Aiming at the Future in 15 Years Time , 2006 .

[17]  Siddharth Swarup Rautaray,et al.  A Real Time Hand Tracking System for Interactive Applications , 2011 .

[18]  E. B. Wilson.  Probable Inference, the Law of Succession, and Statistical Inference , 1927 .

[19]  Reinhard Koch,et al.  Time-of-Flight Sensors in Computer Graphics , 2009, Eurographics.

[20]  M H Schieber,et al.  Quantifying the Independence of Human Finger Movements: Comparisons of Digits, Hands, and Movement Frequencies , 2000, The Journal of Neuroscience.

[21]  T J Armstrong,et al.  A kinematic model of the human hand to evaluate its prehensile capabilities. , 1992, Journal of biomechanics.

[22]  Vitor F. Pamplona,et al.  The Image-Based Data Glove , 2008 .

[23]  Luciana Porcher Nedel,et al.  Testing the Use of Egocentric Interactive Techniques in Immersive Virtual Environments , 2003, INTERACT.

[24]  D. Norman.  The psychology of everyday things", Basic Books Inc , 1988 .

[25]  Gang Xu,et al.  Occlusion-Free Hand Motion Tracking by Multiple Cameras and Particle Filtering with Prediction , 2006 .

[26]  Maurice Haim Krout,et al.  Autistic gestures : an experimental study in symbolic movement , 1935 .

[27]  Rosa María Baños,et al.  Immersion and Emotion: Their Impact on the Sense of Presence , 2004, Cyberpsychology Behav. Soc. Netw..

[28]  Philippe Fuchs,et al.  LA MÉTHODE  : « Interaction et Immersion pour l’Innovation » , 2015, Le traitement du signal et ses applications.

[29]  Stephan Wong,et al.  Adaptive Gaussian Mixture Model for Skin Color Segmentation , 2008 .

[30]  Gabriel Zachmann,et al.  Continuous Edge Gradient-based Template Matching for Articulated Objects , 2009, VISAPP.

[31]  Ashutosh Saxena,et al.  Depth Estimation Using Monocular and Stereo Cues , 2007, IJCAI.

[32]  Ying Wu,et al.  Modeling the constraints of human hand motion , 2000, Proceedings Workshop on Human Motion.

[33]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[34]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[36]  Antonis A. Argyros,et al.  Dynamic time warping for binocular hand tracking and reconstruction , 2008, 2008 IEEE International Conference on Robotics and Automation.

[37]  Martin Tosas.  Visual articulated hand tracking for interactive surfaces , 2006 .

[38]  R. Klein,et al.  Efficient Bimanual Symmetric 3 D Manipulation for Markerless Hand-Tracking , 2009 .

[39]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[40]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[41]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[42]  Simon Richir,et al.  SYNTHÈSES REVIEWS ANTICIPER ET ÉVALUER L'UTILITÉ DANS LA CONCEPTION ERGONOMIQUE DES TECHNOLOGIES ÉMERGENTES : UNE REVUE , 2013 .

[43]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[44]  Julie Pallant,et al.  SPSS survival manual : a step by step guide to data analysis using SPSS for Windows , 2001, Behaviour Change.

[45]  D. Norman.  The psychology of everyday things , 1990 .

[46]  Vincent Hayward,et al.  Toward a seven axis haptic device , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[47]  Gordon Cheng,et al.  Unconstrained Real-time Markerless Hand Tracking for Humanoid Interaction , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[48]  I. Ilayperuma,et al.  Prediction of personal stature based on the hand length , 2009 .

[49]  H. Ouhaddi,et al.  Conception et ajustement d'un modèle 3D articulé de la main , 1998 .

[50]  Philippe Bekaert,et al.  Real-time hand tracking with a colored glove , 2010 .

[51]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[52]  Thomas S. Huang,et al.  Vision based hand modeling and tracking for virtual teleconferencing and telecollaboration , 1995, Proceedings of IEEE International Conference on Computer Vision.