Improving 3D Shape Recognition withElectrostatic Friction Display

Electrovibration technology has the potential for seamless integration into ordinary smartphones and tablets to provide programmable haptic feedback. The aim of this work is to seek effective ways to improve 3D perception of visual objects rendered on an electrovibration display. Utilizing a gradient-based algorithm, we first investigated whether rendering only lateral frictional force on an electrovibration display improves 3D shape perception compared to doing the same using a force-feedback interface. We observed that although users do not naturally associate electrovibration patterns to geometrical shapes, they can map patterns to shapes with moderate accuracy if guidance or context is given. Motivated by this finding, we generalized the gradient-based rendering algorithm to estimate the surface gradient for any 3D mesh and added an edge detection algorithm to render sharp edges. Then, we evaluated the advantages of our algorithm in a user study and found that our algorithm can notably improve the performance of 3D shape recognition when visual information is limited.

[1]  Cagatay Basdogan,et al.  Effect of Waveform in Haptic Perception of Electrovibration on Touchscreens , 2016, EuroHaptics.

[2]  J. Edward Colgate,et al.  Fingertip friction modulation due to electrostatic attraction , 2013, 2013 World Haptics Conference (WHC).

[3]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[4]  Frédéric Giraud,et al.  Electrovibration Modeling Analysis , 2014, EuroHaptics.

[5]  Betty Lemaire-Semail,et al.  Merging two tactile stimulation principles: electrovibration and squeeze film effect , 2013, 2013 World Haptics Conference (WHC).

[6]  J. Edward Colgate,et al.  Surface haptics via electroadhesion: Expanding electrovibration with Johnsen and Rahbek , 2015, 2015 IEEE World Haptics Conference (WHC).

[7]  Xiaoying Sun,et al.  Tactile modeling and rendering image-textures based on electrovibration , 2017, The Visual Computer.

[8]  David J. Beebe,et al.  A polyimide-on-silicon electrostatic fingertip tactile display , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[9]  R. Maini Study and Comparison of Various Image Edge Detection Techniques , 2004 .

[10]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[11]  Markus Gross,et al.  Mesh edge detection , 2000 .

[12]  Jianmin Zheng,et al.  A computational approach to joint line detection on triangular meshes , 2014, Engineering with Computers.

[13]  Yang Zhang,et al.  Quantifying the Targeting Performance Benefit of Electrostatic Haptic Feedback on Touchscreens , 2015, ITS.

[14]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[15]  F. Brooks,et al.  Feeling and seeing: issues in force display , 1990, ACM Symposium on Interactive 3D Graphics and Games.

[16]  Eve E. Hoggan,et al.  Electrostatic Modulated Friction as Tactile Feedback: Intensity Perception , 2012, EuroHaptics.

[17]  E MALLINCKRODT,et al.  Perception by the skin of electrically induced vibrations. , 1953, Science.

[18]  Seungmoon Choi,et al.  Investigation on Low Voltage Operation of Electrovibration Display , 2017, IEEE Transactions on Haptics.

[19]  Gholamreza Ilkhani,et al.  Data-Driven Texture Rendering with Electrostatic Attraction , 2014, EuroHaptics.

[20]  Seung-Chan Kim,et al.  Tactile rendering of 3D features on touch surfaces , 2013, UIST.

[21]  Donald E. Troxel,et al.  An Electrotactile Display , 1970 .

[22]  Wei Tsang Ooi,et al.  Sprite tree: an efficient image-based representation for networked virtual environments , 2017, The Visual Computer.

[23]  Seung-Chan Kim,et al.  A New Surface Display for 3D Haptic Rendering , 2014, EuroHaptics.

[24]  Nidhi Chandrakar,et al.  Study and comparison of various image edge detection techniques , 2012 .

[25]  Akio Yamamoto,et al.  Multi-finger electrostatic passive haptic feedback on a visual display , 2013, 2013 World Haptics Conference (WHC).

[26]  Jeha Ryu,et al.  Method for Providing Electrovibration with Uniform Intensity , 2015, IEEE Transactions on Haptics.

[27]  Seungmoon Choi,et al.  Identification of primitive geometrical shapes rendered using electrostatic friction display , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[28]  Hiroshi Haga,et al.  43.3: Electrostatic Tactile Display Using Beat Phenomenon of Voltage Waveforms , 2014 .

[29]  P BrooksFrederick,et al.  Feeling and seeing: issues in force display , 1990 .