Design and Evaluation of Mid-Air Haptic Interactions in an Augmented Reality Environment

Augmented Reality mid-air environments are currently re-evaluating the interaction principles of the objects rendered in space. The surface, texture complexity, compliances and dynamics can be represented through volumetric rendering, comprised of shape, size and/or volume. Haptic representation of the graphical content and the dynamics of the interface can be tailored to the application requirements. The solution, however, is highly dependent on the tasks and the need for tactile feedback. The ideal system must blend the right level of factors and attributes to maximize user performance and satisfaction. The mechanics and perceptual correlation of mid-air haptics are still unresolved. Based on human tactile limitations, the prime classification of the tactile interactions was proposed, based on spatial and temporal requirements and limitations. Proposed classes are intuitive and proved to be easily adapted to many interactions, as well as compatible with gesture recognition. This paper discusses the haptic design criteria for mid-air, tactile-enhanced interactions suitable for interface AR applications. Design evaluation involved a sequence of six scenes, directed to engage user attention and strengthen performance. Proposed solution and its influence on ergonomics and efficiency, were subjected to user cognitive evaluation. A non-contact, interactive demo, blending cross modal stimulations, combining vision, auditory and tactile sensations was produced, and user studies were discussed.

[1]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[2]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[3]  Paul Issartel,et al.  HAIR: HAptic feedback with a mobile AIR jet , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Inwook Hwang,et al.  AirPiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback , 2017, 2017 IEEE World Haptics Conference (WHC).

[5]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[6]  Angelika Peer,et al.  Haptic Perception of Material Properties and Implications for Applications , 2013, Proceedings of the IEEE.

[7]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[8]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[9]  J. Gibson Observations on active touch. , 1962, Psychological review.

[10]  Felix Raymond,et al.  Touch hologram in mid-air , 2017, SIGGRAPH Emerging Technologies.

[11]  Young J. Kim,et al.  Interactive generalized penetration depth computation for rigid and articulated models using object norm , 2014, ACM Trans. Graph..

[12]  Gudrun Klinker,et al.  Augmented reality as a comparison tool in automotive industry , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[13]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[14]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.