Non-Contact Thermo-Visual Augmentation by IR-RGB Projection

This paper presents an approach for non-contact haptic augmentation with spatial augmented reality (SAR). We construct a thermo-visual projection system by combining a standard RGB projector and a fabricated infrared (IR) projector. The primary contribution of this paper is that we conduct thorough psychophysical experiments to investigate a design guideline for spatiotemporal projection patterns for both RGB and IR projectors to render a warm object with high presence. We develop application systems to evaluate the validity of the proposed system and design guideline. The evaluation results demonstrate that the proposed system can render warm objects with significantly higher presence than a standard SAR system.

[1]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[2]  Kazuhiko Yokosawa,et al.  Does Seeing Ice Really Feel Cold? Visual-Thermal Interaction under an Illusory Body-Ownership , 2012, PloS one.

[3]  Kosuke Sato,et al.  Extended Depth-of-Field Projector by Fast Focal Sweep Projection , 2015, IEEE Transactions on Visualization and Computer Graphics.

[4]  Arindam Dey,et al.  Burnar: Involuntary heat sensations in augmented reality , 2013, 2013 IEEE Virtual Reality (VR).

[5]  Yasutoshi Makino,et al.  HaptoClone (Haptic-Optical Clone) for Mutual Tele-Environment by Real-time 3D Image Transfer with Midair Force Feedback , 2016, CHI.

[6]  Shiro Suyama,et al.  Floating aerial LED signage based on aerial imaging by retro-reflection (AIRR). , 2014, Optics express.

[7]  Eyal Ofek,et al.  Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment , 2016, CSCW.

[8]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[9]  Satoshi Saga,et al.  HeatHapt Thermal Radiation-Based Haptic Display , 2014, AsiaHaptics.

[10]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[11]  Hiroyuki Shinoda,et al.  HaptoMime: mid-air haptic interaction with a floating virtual screen , 2014, UIST.

[12]  Desney S. Tan,et al.  AirWave: non-contact haptic feedback using air vortex rings , 2013, UbiComp.

[13]  Lawrence E. Marks,et al.  Spatial localization of warmth , 1975 .

[14]  Daisuke Iwai,et al.  Combining colour and temperature: A blue object is more likely to be judged as warm than a red object , 2014, Scientific Reports.

[15]  Kosuke Sato,et al.  Limpid desk: see-through access to disorderly desktop in projection-based mixed reality , 2006, VRST '06.

[16]  Kosuke Sato,et al.  Dynamic defocus and occlusion compensation of projected imagery by model-based optimal projector selection in multi-projection environment , 2011, Virtual Reality.

[17]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[18]  R. Klatzky,et al.  Relative availability of surface and object properties during early haptic processing. , 1997, Journal of experimental psychology. Human perception and performance.

[19]  Kosuke Sato,et al.  Consistent desktop sharing based on document coordinate system for face-to-face online meeting , 2015, SIGGRAPH Asia Emerging Technologies.

[20]  Kosuke Sato,et al.  SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality , 2015, IEEE Transactions on Visualization and Computer Graphics.

[21]  Anselm Grundhöfer,et al.  Augmenting physical avatars using projector-based illumination , 2013, ACM Trans. Graph..

[22]  Gordon Wetzstein,et al.  The visual computing of projector-camera systems , 2008, SIGGRAPH '08.

[23]  Daisuke Iwai,et al.  Projection screen reflectance control for high contrast display using photochromic compounds and UV LEDs. , 2014, Optics express.

[24]  Kosuke Sato,et al.  A study of thermal sensation with visuo-thermal projection interfaces , 2013, 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE).

[25]  Hirotsugu Yamamoto,et al.  Bidirectional Visual and Thermal 3D Information Display by Use Crossed-Mirror Array , 2014 .

[26]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[27]  Kosuke Sato,et al.  Document search support by making physical documents transparent in projection-based mixed reality , 2011, Virtual Reality.

[28]  Kosuke Sato,et al.  Shadow removal of projected imagery by occluder shape measurement in a multiple overlapping projection system , 2014, Virtual Reality.

[29]  Kosuke Sato,et al.  3D high dynamic range display system , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[30]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.