Design and Evaluation of Freehand Gesture Interaction for Light Field Display

The paper reports on a user study of freehand gesture interaction with a prototype of autostereoscopic 3D light field display. The interaction was based on a direct touch selection of simple objects rendered at different positions in space. The main goal of our experiment was to evaluate the overall user experience and perceived cognitive workload of such freehand interaction in 3D environment and compare it to the simplified touch-based interaction in 2D environment. The results of the experiment confirmed the hypothesis that significantly more time is required for the interaction in 3D than the interaction in 2D. Surprisingly, no significant difference was found in the results of the assessment of cognitive workload when comparing 3D and 2D. We believe the interaction scenario proposed and evaluated in this study could represent an efficient and intuitive future interaction technique for the selection and manipulation of content rendered on autostereoscopic 3D displays

[1]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3d volumetric displays , 2004, UIST '04.

[2]  Beatrice Gralton,et al.  Washington DC - USA , 2008 .

[3]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[4]  David Kim,et al.  Vermeer: direct interaction with a 360° viewable 3D display , 2011, UIST.

[5]  Brennon Bortz,et al.  Poster: Exploring the integrality and separability of the Leap Motion Controller for direct manipulation 3D interaction , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[6]  Jane Yung-jen Hsu,et al.  Touching the void: direct-touch interaction for intangible displays , 2010, CHI.

[7]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[8]  Joze Guna,et al.  An Analysis of the Precision and Reliability of the Leap Motion Sensor and Its Suitability for Static and Dynamic Tracking , 2014, Sensors.

[9]  Gerd Bruder,et al.  To touch or not to touch?: comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces , 2013, SUI '13.

[10]  Daniel Vogel,et al.  Distant freehand pointing and clicking on very large, high resolution displays , 2005, UIST.

[11]  Bruno Fanini.  A 3D Interface to Explore and Manipulate Multi-scale Virtual Scenes using the Leap Motion Controller , 2014, ACHI 2014.

[12]  Fons J. Verbeek,et al.  Pointing Task Evaluation of Leap Motion Controller in 3D Virtual Environment , 2014 .

[13]  Péter Tamás Kovács,et al.  Holovizio 3D Display System , 2007, 2007 3DTV Conference.

[14]  Sylvain Paris,et al.  6D hands: markerless hand-tracking for computer aided design , 2011, UIST.

[15]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[16]  Enrico Gobbetti,et al.  A Large Scale Interactive Holographic Display , 2006, IEEE Virtual Reality Conference (VR 2006).

[17]  David Kim,et al.  HoloDesk: direct 3d interactions with a situated see-through display , 2012, CHI.