Visual saliency guided textured model simplification

Mesh geometry can be used to model both object shape and details. If texture maps are involved, it is common to let mesh geometry mainly model object shapes and let the texture maps model the most object details, optimising data size and complexity of an object. To support efficient object rendering and transmission, model simplification can be applied to reduce the modelling data. However, existing methods do not well consider how object features are jointly represented by mesh geometry and texture maps, having problems in identifying and preserving important features for simplified objects. To address this, we propose a visual saliency detection method for simplifying textured 3D models. We produce good simplification results by jointly processing mesh geometry and texture map to produce a unified saliency map for identifying visually important object features. Results show that our method offers a better object rendering quality than existing methods.

[1]  David P. Luebke,et al.  Perceptually-Driven Simplification for Interactive Rendering , 2001, Rendering Techniques.

[2]  Christof Koch,et al.  Feature combination strategies for saliency-based visual attention systems , 2001, J. Electronic Imaging.

[3]  Mateu Sbert,et al.  A unified information-theoretic framework for viewpoint selection and mesh saliency , 2009, TAP.

[4]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[5]  Thomas A. Funkhouser,et al.  Schelling points on 3D surface meshes , 2012, ACM Trans. Graph..

[6]  Frederick P. Brooks,et al.  Fast spheres, shadows, textures, transparencies, and imgage enhancements in pixel-planes , 1985, Advances in Computer Graphics.

[7]  Harold Pashler.  Computational modeling of spatial attention , 2016 .

[8]  Alvaro Soto,et al.  Human detection using a mobile platform and novel features derived from a visual saliency mechanism , 2010, Image Vis. Comput..

[9]  Carlos Andújar,et al.  Space-Optimized Texture Atlases for 3D Scenes with Per-polygon Textures , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[10]  Rynson W. H. Lau,et al.  Game-on-demand:: An online game engine based on geometry streaming , 2011, TOMCCAP.

[11]  Pedro V. Sander,et al.  Texture mapping progressive meshes , 2001, SIGGRAPH.

[12]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[13]  Jonathan D. Cohen,et al.  Uniform frequency images: adding geometry to images to produce space-efficient textures , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[14]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[15]  Daisuke Kihara,et al.  Salient critical points for meshes , 2007, Symposium on Solid and Physical Modeling.

[16]  S. Yantis,et al.  Visual Attention: Bottom-Up Versus Top-Down , 2004, Current Biology.

[17]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[18]  Walter F. Bischof,et al.  A Perceptual Approach to Texture Scaling based on Human Computer Interaction , 2006, Eurographics.

[19]  Tolga K. Çapin,et al.  Saliency for animated meshes with material properties , 2010, APGV '10.

[20]  Gabriel Taubin,et al.  Estimating the tensor of curvature of a surface from a polyhedral approximation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  Scott Schaefer,et al.  Image deformation using moving least squares , 2006, ACM Trans. Graph..

[22]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[23]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[24]  Adam Hunter,et al.  Uniform frequency images: adding geometry to images to produce space-efficient textures , 2000 .

[25]  Michael C. Mozer,et al.  Computational modeling of spatial attention , 1996 .

[26]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[27]  Renato Pajarola,et al.  Visual saliency guided normal enhancement technique for 3D shape depiction , 2011, Comput. Graph..

[28]  Gabriel Taubin,et al.  Space‐Optimized Texture Maps , 2002 .

[29]  Libor Vása,et al.  Perceptual Metrics for Static and Dynamic Triangle Meshes , 2013, Eurographics.

[30]  Nikolay N. Ponomarenko,et al.  METRICS PERFORMANCE COMPARISON FOR COLOR IMAGE DATABASE , 2008 .

[31]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[32]  Ayellet Tal,et al.  Surface Regions of Interest for Viewpoint Selection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jieqing Feng,et al.  Perceptual-saliency extremum lines for 3D shape illustration , 2010, The Visual Computer.

[34]  Kurt Debattista,et al.  A GPU based saliency map for high-fidelity selective rendering , 2006, AFRIGRAPH '06.

[35]  Hujun Bao,et al.  Importance-driven texture encoding based on samples , 2005, International 2005 Computer Graphics.

[36]  G. Turk,et al.  Model simplification using image and geometry-based metrics , 2000 .

[37]  Mateu Sbert,et al.  Simplification method for textured polygonal meshes based on structural appearance , 2013, Signal Image Video Process..

[38]  FeixasMiquel,et al.  A unified information-theoretic framework for viewpoint selection and mesh saliency , 2009 .

[39]  Tomas Akenine-Möller,et al.  iPACKMAN: high-quality, low-complexity texture compression for mobile phones , 2005, HWWS '05.

[40]  Ralph R. Martin,et al.  Mesh saliency via spectral processing , 2014, ACM Trans. Graph..

[41]  Amitabh Varshney,et al.  Saliency-guided Enhancement for Volume Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[42]  Michael Guthe,et al.  Towards Perceptual Simplification of Models with Arbitrary Materials , 2010, Comput. Graph. Forum.

[43]  Kyung-Joong Kim,et al.  3D game model and texture generation using interactive genetic algorithm , 2012, WASA '12.

[44]  Xun Wang,et al.  Salient Region of Textured 3D Model , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[45]  Guillaume Lavoué,et al.  A local roughness measure for 3D meshes and its application to visual masking , 2009, TAP.