Design and Evaluation of Interaction Techniques Dedicated to Integrate Encountered-Type Haptic Displays in Virtual Environments

Encountered-Type Haptic Displays (ETHDs) represent a field of haptic displays with the premise of not using any type of actuator directly in contact with the user skin, thus providing an alternative integration of haptic displays in virtual environments. In this paper, we present novel interaction techniques (ITs) dedicated to ETHDs. The techniques aim at addressing the issues commonly presented for these devices such as limited contact areas, lags and unexpected collisions with the user. First, our paper proposes a design framework based on several parameters defining the interactive process between user and ETHD (input, movement control, displacement and contact). Five techniques based on different ramifications of the design space framework were conceived, respectively named: Swipe, Drag, Clutch, Bubble and Follow. Then, a use-case scenario was designed to depict the usage of these techniques on the task of touching and coloring a wide, flat surface. Finally, a user study based on the coloring task was conducted to assess the performance and user experience for each IT. Results were in favor of Drag and Clutch techniques which are based on manual surface displacement, absolute position selection and intermittent contact interaction. Taken together our results and design methodology pave the way to the design of future ITs for ETHDs in virtual environments.

[1]  J. Landay,et al.  Beyond The Force: Using Quadcopters to Appropriate Objects and the Environment for Haptics in Virtual Reality , 2019, CHI.

[2]  Takeo Kanade,et al.  What you can see is what you can feel-development of a visual/haptic interface to virtual environment , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[3]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[4]  Muhammad Abdullah,et al.  HapticDrone: An Encountered-Type Kinesthetic Haptic Interface with Controllable Force Feedback: Initial Example for 1D Haptic Feedback , 2017, UIST.

[5]  Gerd Bruder,et al.  Effects of visual conflicts on 3D selection task performance in stereoscopic display environments , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[6]  Hiroyuki Kajimoto,et al.  An Encounter Type VR System Aimed at Exhibiting Wall Material Samples for Show House , 2018, ISS.

[7]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[8]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[9]  Sean Follmer,et al.  Visuo-Haptic Illusions for Improving the Perceived Performance of Shape Displays , 2018, CHI.

[10]  Chang-Gyu Lee,et al.  Visual Guidance for Encountered Type Haptic Display: A feasibility study , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[11]  Markus Funk,et al.  VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters , 2018, MUM.

[12]  F. Barbagli,et al.  Evaluating haptics and 3D stereo displays using Fitts' law , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[13]  Daniel Brice,et al.  A Novel Force Feedback Haptics System with Applications in Phobia Treatment , 2017, WSCG 2017.

[14]  Martin Schrepp,et al.  Applying the User Experience Questionnaire (UEQ) in Different Evaluation Scenarios , 2014, HCI.

[15]  Eyal Ofek,et al.  Demonstration of Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a VR Controller , 2018, CHI Extended Abstracts.

[16]  Hiroo Iwata,et al.  Encounter-Type Haptic Interfaces for Virtual Reality Musical Instruments , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[17]  Hannes Kaufmann,et al.  VRRobot: Robot actuated props in an infinite virtual environment , 2017, 2017 IEEE Virtual Reality (VR).

[18]  Rubaiat Habib Kazi,et al.  Experimental Evaluation of Sketching on Surfaces in VR , 2017, CHI.

[19]  Scott Devine,et al.  A Point Contact Encounter Haptic Solution with the HTC VIVE and Baxter Robot , 2017, WSCG 2017.

[20]  Hyun Jung Kim,et al.  Encountered‐type haptic display for large VR environment using per‐plane reachability maps , 2018, Comput. Animat. Virtual Worlds.

[21]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[22]  Markus Funk,et al.  Flyables: Exploring 3D Interaction Spaces for Levitating Tangibles , 2018, Tangible and Embedded Interaction.

[23]  Maud Marchal,et al.  ENTROPiA: Towards Infinite Surface Haptic Displays in Virtual Reality Using Encountered-Type Rotating Props , 2019, IEEE Transactions on Visualization and Computer Graphics.

[24]  C. MacKenzie,et al.  Three-Dimensional Movement Trajectories in Fitts' Task: Implications for Control , 1987 .

[25]  Simon Richir,et al.  A Comparison of Three Techniques to Interact in Large Virtual Environments Using Haptic Devices with Limited Workspace , 2006, Computer Graphics International.

[26]  Robert J. Teather,et al.  Pointing at 3D targets in a stereo head-tracked virtual environment , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[27]  Murat Cenk Cavusoglu,et al.  Effect of visuo-haptic co-location on 3D Fitts' task performance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Hiroshi Ishii,et al.  Mediate: A Spatial Tangible Interface for Mixed Reality , 2018, CHI Extended Abstracts.

[29]  Carlo Alberto Avizzano,et al.  Encountered-type haptic interface for virtual interaction with real objects based on implicit surface haptic rendering for remote palpation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Markus Funk,et al.  Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters , 2017, CHI Extended Abstracts.

[31]  Simon Richir,et al.  The "Bubble" technique: interacting with large virtual environments using haptic devices with limited workspace , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[32]  A. Murata,et al.  Extending Fitts' law to a three-dimensional pointing task. , 2001, Human movement science.

[33]  Daniel J. Wigdor,et al.  Snake Charmer: Physically Enabling Virtual Objects , 2016, TEI.