Appearance-preserving tactile optimization

Textures are encountered often on various common objects and surfaces. Many textures combine visual and tactile aspects, each serving important purposes; most obviously, a texture alters the object's appearance or tactile feeling as well as serving for visual or tactile identification and improving usability. The tactile feel and visual appearance of objects are often linked, but they may interact in unpredictable ways. Advances in high-resolution 3D printing enable highly flexible control of geometry to permit manipulation of both visual appearance and tactile properties. In this paper, we propose an optimization method to independently control the tactile properties and visual appearance of a texture. Our optimization is enabled by neural network-based models, and allows the creation of textures with a desired tactile feeling while preserving a desired visual appearance at a relatively low computational cost, for use in a variety of applications.

[1]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[2]  Dani Lischinski,et al.  Non-stationary texture synthesis by adversarial expansion , 2018, ACM Trans. Graph..

[3]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[5]  Antonio Krüger,et al.  Enhancing Texture Perception in Virtual Reality Using 3D-Printed Hair Structures , 2019, CHI.

[6]  Andrea Vedaldi,et al.  Texture Networks: Feed-forward Synthesis of Textures and Stylized Images , 2016, ICML.

[7]  Wojciech Matusik,et al.  An interaction-aware, perceptual model for non-linear elastic objects , 2016, ACM Trans. Graph..

[8]  Eric Paulos,et al.  HapticPrint: Designing Feel Aesthetics for Digital Fabrication , 2015, UIST.

[9]  Charlie C. L. Wang,et al.  Thermal-Comfort Design of Personalized Casts , 2017, UIST.

[10]  Ying Yang,et al.  A 3D Steganalytic Algorithm and Steganalysis-Resistant Watermarking , 2017, IEEE Transactions on Visualization and Computer Graphics.

[11]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[12]  Mark Hollins,et al.  The coding of roughness. , 2007, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[13]  Jaakko Lehtinen,et al.  Differentiable Monte Carlo ray tracing through edge sampling , 2018, ACM Trans. Graph..

[14]  Denis Zorin,et al.  A Quantitative Perceptual Model for Tactile Roughness , 2018, ACM Trans. Graph..

[15]  Wojciech Matusik,et al.  Spec2Fab , 2013, ACM Trans. Graph..

[16]  Hannes P. Saal,et al.  Natural scenes in tactile texture. , 2014, Journal of neurophysiology.

[17]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[18]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[19]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[20]  A. Kappers,et al.  Tactile perception of thermal diffusivity , 2009, Attention, perception & psychophysics.

[21]  Christian Eitzinger,et al.  Making Tactile Textures with Predefined Affective Properties , 2014, IEEE Transactions on Affective Computing.

[22]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[23]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[24]  Daniel Cremers,et al.  Fight Ill-Posedness with Ill-Posedness: Single-shot Variational Depth Super-Resolution from Shading , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Atilla Baskurt,et al.  A Comprehensive Survey on Three-Dimensional Mesh Watermarking , 2008, IEEE Transactions on Multimedia.

[26]  W. B. Tiest.  Tactual perception of material properties , 2010, Vision Research.

[27]  J. Hesthaven,et al.  Non-intrusive reduced order modeling of nonlinear problems using neural networks , 2018, J. Comput. Phys..

[28]  Leon A. Gatys,et al.  Texture Synthesis Using Convolutional Neural Networks , 2015, NIPS.

[29]  E. P. Gardner,et al.  Tactile perception of the roughness of 3D-printed textures. , 2018, Journal of neurophysiology.

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[32]  Wojciech Matusik,et al.  Deep multispectral painting reproduction via multi-layer, custom-ink printing , 2018, ACM Trans. Graph..

[33]  Marc Alexa,et al.  3D-Printing Spatially Varying BRDFs , 2013, IEEE Computer Graphics and Applications.

[34]  C. Connor,et al.  Tactile roughness: neural codes that account for psychophysical magnitude estimates , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Fang-Lue Zhang,et al.  A survey of the state-of-the-art in patch-based synthesis , 2017, Computational Visual Media.

[37]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[39]  Iasonas Kokkinos,et al.  Describing Textures in the Wild , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Karol Myszkowski,et al.  Scattering-aware texture reproduction for 3D printing , 2017, ACM Trans. Graph..

[41]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[42]  Leon A. Gatys,et al.  A parametric texture model based on deep convolutional features closely matches texture appearance for humans , 2017, bioRxiv.

[43]  Michael Weinmann,et al.  Using patch-based image synthesis to measure perceptual texture similarity , 2019, Comput. Graph..

[44]  Eli Shechtman,et al.  Texture Mixer: A Network for Controllable Synthesis and Interpolation of Texture , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Olga Sorkine-Hornung,et al.  Appearance-mimicking surfaces , 2014, ACM Trans. Graph..

[46]  Xin Wang,et al.  3D printing of polymer matrix composites: A review and prospective , 2017 .