Geometry-based haptic texture modeling and rendering using photometric stereo

This paper presents an improved approach to geometry-based haptic texture modeling and rendering. We adopt photometric stereo, one of the most accurate algorithms for 3D surface reconstruction, to increase the resolution of captured geometry profiles. This benefit of higher texture resolution can enhance the realism of rendered textures in terms of roughness. To this end, we have designed and constructed a dome-shaped lighting structure for use in the modeling using photometric stereo. With this apparatus and the photometric stereo algorithms, we can achieve very high texture modeling resolution in the order of 10 pm. We also identify the stiffness and friction of real materials using the Hunt-Crossley model and the Dahl model, respectively, for realistic texture rendering. A user study measuring the perceived similarity between real and virtual textures demonstrated that our system can achieve a reasonably high level of realism in rendering textured objects with high compliance or low friction.

[1]  K. H. Hunt,et al.  Coefficient of Restitution Interpreted as Damping in Vibroimpact , 1975 .

[2]  P. Dahl.  Solid Friction Damping of Mechanical Vibrations , 1976 .

[3]  Terril Hurst,et al.  Disk drive pivot nonlinearity modeling. II. Time domain , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[4]  Susan J. Lederman,et al.  Computational haptics: the sandpaper system for synthesizing texture for a force-feedback display , 1995 .

[5]  Thomas Harold Massie,et al.  Initial haptic explorations with the phantom : virtual touch through point interaction , 1996 .

[6]  Cagatay Basdogan,et al.  A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments , 1997, Dynamic Systems and Control.

[7]  Yasushi Ikei,et al.  Vibratory Tactile Display of Image-Based Textures , 1997, IEEE Computer Graphics and Applications.

[8]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[9]  S. Wall,et al.  Modelling of Surface Identifying Characteristics Using Fourier Series , 1999, Dynamic Systems and Control.

[10]  M. Cutkosky,et al.  Roughness Perception of Haptically Displayed Fractal Surfaces , 2000, Dynamic Systems and Control: Volume 2.

[11]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[12]  Vincent Hayward,et al.  Change of Height: An Approach to the Haptic Display of Shape and Texture Without Surface Normal , 2002, ISER.

[13]  Li Zhang,et al.  Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multiview stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Dinesh K. Pai,et al.  The WHaT: a wireless haptic texture sensor , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[15]  R. Klatzky,et al.  Feeling textures through a probe: Effects of probe and surface geometry and exploratory factors , 2003, Perception & psychophysics.

[16]  Mike J. Chantler,et al.  Optimal illumination for three-image photometric stereo acquisition of surface texture , 2003 .

[17]  Hong Z. Tan,et al.  Toward realistic haptic rendering of surface textures , 2004, IEEE Computer Graphics and Applications.

[18]  Ming C. Lin,et al.  A perceptually-inspired force model for haptic texture rendering , 2004, APGV '04.

[19]  Andrew W. Fitzgibbon,et al.  BRDF and geometry capture from extended inhomogeneous samples using flash photography , 2005, Comput. Graph. Forum.

[20]  Hong Z. Tan,et al.  Force constancy and its effect on haptic perception of virtual surfaces , 2005, TAP.

[21]  Allison M. Okamura,et al.  Friction compensation for a force-feedback telerobotic system , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[22]  Keyvan Hashtrudi-Zaad,et al.  A new method for online parameter estimation of Hunt-Crossley environment dynamic models , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Takashi Yoshioka,et al.  Automatic filter design for synthesis of haptic textures from recorded acceleration data , 2010, 2010 IEEE International Conference on Robotics and Automation.

[24]  Jochen Lang,et al.  Measurement-Based Modeling of Contact Forces and Textures for Haptic Rendering , 2011, IEEE Transactions on Visualization and Computer Graphics.

[25]  G. Campion.  The Synthesis of Three Dimensional Haptic Textures: Geometry, Control, and Psychophysics , 2011 .

[26]  Seokhee Jeon,et al.  Real Stiffness Augmentation for Haptic Augmented Reality , 2011, PRESENCE: Teleoperators and Virtual Environments.

[27]  Jochen Lang,et al.  IIR Filter Models of Haptic Vibration Textures , 2011, IEEE Transactions on Instrumentation and Measurement.

[28]  Max Mintz,et al.  Refined methods for creating realistic haptic virtual textures from tool-mediated contact acceleration data , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[29]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[30]  Matthias Harders,et al.  Rendering Virtual Tumors in Real Tissue Mock-Ups Using Haptic Augmented Reality , 2012, IEEE Transactions on Haptics.

[31]  Heather Culbertson,et al.  Generating haptic texture models from unconstrained tool-surface interactions , 2013, 2013 World Haptics Conference (WHC).

[32]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[33]  Heather Culbertson,et al.  One hundred data-driven haptic texture models and open-source methods for rendering on 3D objects , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[34]  Seungmoon Choi,et al.  Data-driven modeling of isotropic haptic textures using frequency-decomposed neural networks , 2015, 2015 IEEE World Haptics Conference (WHC).

[35]  Sunghoon Yim,et al.  Data-Driven Haptic Modeling and Rendering of Viscoelastic and Frictional Responses of Deformable Objects , 2016, IEEE Transactions on Haptics.

[36]  Seokhee Jeon,et al.  Data-Driven Modeling of Anisotropic Haptic Textures: Data Segmentation and Interpolation , 2016, EuroHaptics.

[37]  Marco Barbieri,et al.  A contact mechanics interpretation of the duplex theory of tactile texture perception , 2016 .

[38]  Seokhee Jeon,et al.  Sample selection of multi-trial data for data-driven haptic texture modeling , 2017, 2017 IEEE World Haptics Conference (WHC).

[39]  Mike Chantler,et al.  Optimal illumination for three-image photometric stereo acquisition of texture , 2022 .