Light-weight immaterial particle displays with mid-air tactile feedback

Immaterial mid-air displays formed of flowing light-scattering particles are becoming feasible for displaying information in thin air and interacting with it. With light-weight desktop fogscreens and low-cost hand tracking, the user can easily and unobtrusively interact with virtual information. Any real objects can be seen or reached through the screen, as it is permeable and almost intangible. However, no tactile feedback can be perceived when interacting with a mid-air display. Our contribution in this paper is the construction of an interactive mid-air fogscreen employing ultrasonic phased arrays in order to create mid-air tactile feedback. The feedback is suitable for small desktop-sized fogscreens. This creates a mixed reality setup where real objects and e.g., augmented reality content can be brought closer together conceptually and physically. In an experimental evaluation of the mid-air tactile feedback for the fogscreen we found no statistically significant difference in performance, but the mid-air tactile feedback was slightly preferred over no tactile feedback by the users. They found the tactile feedback as more engaging.

[1]  Ismo Rakkolainen,et al.  A hand-held immaterial volumetric display , 2014, Electronic Imaging.

[2]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[3]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[4]  Hiroyuki Shinoda,et al.  Aerial display of vibrotactile sensation with high spatial-temporal resolution using large-aperture airborne ultrasound phased array , 2013, 2013 World Haptics Conference (WHC).

[5]  Ismo Rakkolainen Feasible mid-air virtual reality with the immaterial projection screen technology , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[6]  Martin L. Lenhardt,et al.  Airborne ultrasonic standards for hearing protection, 2008 , 2008 .

[7]  Ismo Rakkolainen,et al.  Walk-thru screen , 2002, IS&T/SPIE Electronic Imaging.

[8]  Ismo Rakkolainen,et al.  Bidirectional touch interaction for immaterial displays , 2014, MindTrek.

[9]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[10]  Stephen A. Brewster,et al.  Tactile Feedback for Above-Device Gesture Interfaces: Adding Touch to Touchless Interactions , 2014, ICMI.

[11]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[12]  Hiroyuki Shinoda,et al.  Adding tactile reaction to hologram , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[13]  Małgorzata Pawlaczyk-Łuszczyńska,et al.  Effects of Ultrasonic Noise on the Human Body—A Bibliographic Review , 2013, International journal of occupational safety and ergonomics : JOSE.

[14]  Ismo Rakkolainen,et al.  A Survey of 3DTV Displays: Techniques and Technologies , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Ismo Rakkolainen,et al.  Improved Interaction for Mid-Air Projection Screen Technology , 2015 .

[16]  J J Koenderink,et al.  Haptic curvature discrimination at several regions of the hand , 1997, Perception & psychophysics.

[17]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[18]  Jaehoon Jung,et al.  Psychophysical Model for Vibrotactile Rendering in Mobile Devices , 2010, PRESENCE: Teleoperators and Virtual Environments.

[19]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[20]  Ismo Rakkolainen,et al.  Midair User Interfaces Employing Particle Screens , 2015, IEEE Computer Graphics and Applications.

[21]  Hiroyuki Shinoda,et al.  HaptoMime: mid-air haptic interaction with a floating virtual screen , 2014, UIST.

[22]  Desney S. Tan,et al.  AirWave: non-contact haptic feedback using air vortex rings , 2013, UbiComp.