Multi-scale mesh saliency based on low-rank and sparse analysis in shape feature space

This paper advocates a novel multi-scale mesh saliency method using the powerful low-rank and sparse analysis in shape feature space. The technical core of our approach is a new shape descriptor that embraces both local geometry information and global structure information in an integrated way. Our shape descriptor is organized in a layered and nested structure, enabling both multi-scale and multi-level functionalities. Upon devising our novel shape descriptor, the remaining challenge is to accurately capture sub-region (or sub-part) saliency from 3D geometric models. Towards this goal, we exploit our novel shape descriptor to define local-to-global shape context in a vertex-wise fashion and concatenate all the shape contexts to form a feature space, which encodes both local geometry feature and global structure feature. It then paves the way for us to employ the powerful low-rank and sparse analysis in the feature space, because the low-rank components emphasize much more on stronger patch/part similarities, and the sparse components correspond to their differences. By focusing on the sparse components, we develop a versatile, structure-sensitive saliency detection framework, which can distinguish local geometry saliency and global structure saliency in various 3D geometric models. Our extensive experiments have exhibited many attractive properties of our novel shape descriptor, including: being suitable for perception-driven analysis, being structure-sensitive, multi-scale, discriminative, and effectively capturing the intrinsic characteristic of the underlying geometry.

[1]  Ayellet Tal,et al.  Surface Regions of Interest for Viewpoint Selection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yu Fu,et al.  Visual saliency detection by spatially weighted dissimilarity , 2011, CVPR 2011.

[3]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[4]  David W. Jacobs,et al.  Mesh saliency and human eye fixations , 2010, TAP.

[5]  Marc Alexa,et al.  Laplacian mesh optimization , 2006, GRAPHITE '06.

[6]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[7]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[8]  Amitabh Varshney,et al.  Persuading Visual Attention through Geometry , 2008, IEEE Transactions on Visualization and Computer Graphics.

[9]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dacheng Tao,et al.  GoDec: Randomized Lowrank & Sparse Matrix Decomposition in Noisy Case , 2011, ICML.

[11]  Xi Chen,et al.  New approach to texture saliency based on intrinsic relationship among texture features , 2007, International Symposium on Multispectral Image Processing and Pattern Recognition.

[12]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[14]  Cláudio T. Silva,et al.  Vector Field k‐Means: Clustering Trajectories by Fitting Multiple Vector Fields , 2012, Comput. Graph. Forum.

[15]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[16]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[17]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[18]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[19]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[22]  Mark Meyer,et al.  Implicit fairing of irregular meshes using diffusion and curvature flow , 1999, SIGGRAPH.

[23]  Young J. Kim,et al.  Interactive generalized penetration depth computation for rigid and articulated models using object norm , 2014, ACM Trans. Graph..

[24]  P. König,et al.  Does luminance‐contrast contribute to a saliency map for overt visual attention? , 2003, The European journal of neuroscience.

[25]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Thomas A. Funkhouser,et al.  Distinctive regions of 3D surfaces , 2007, TOGS.

[27]  Ralph R. Martin,et al.  Mesh saliency via spectral processing , 2014, ACM Trans. Graph..

[28]  Baoxin Li,et al.  Mining discriminative components with low-rank and sparsity constraints for face recognition , 2012, KDD.

[29]  Junchi Yan,et al.  Visual Saliency Detection via Sparsity Pursuit , 2010, IEEE Signal Processing Letters.

[30]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[31]  Thomas A. Funkhouser,et al.  Biharmonic distance , 2010, TOGS.

[32]  Amitabh Varshney,et al.  Saliency-guided Enhancement for Volume Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[33]  Xiaohu Guo,et al.  Spectral mesh deformation , 2008, The Visual Computer.

[34]  Hans-Peter Seidel,et al.  Real-time lens blur effects and focus control , 2010, SIGGRAPH 2010.

[35]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Ligang Liu,et al.  Easy Mesh Cutting , 2006, Comput. Graph. Forum.

[37]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[38]  Rongrong Ji,et al.  Saliency detection based on short-term sparse representation , 2010, 2010 IEEE International Conference on Image Processing.

[39]  Juan Manuel Montero-Martínez,et al.  Histogram Equalization-Based Features for Speech, Music, and Song Discrimination , 2010, IEEE Signal Processing Letters.

[40]  Ligang Liu,et al.  Mesh saliency with global rarity , 2013, Graph. Model..

[41]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[42]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[43]  Mateu Sbert,et al.  A unified information-theoretic framework for viewpoint selection and mesh saliency , 2009, TAP.

[44]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[45]  KochChristof,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 1998 .

[46]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[47]  Ayellet Tal,et al.  Metamorphosis of Polyhedral Surfaces using Decomposition , 2002, Comput. Graph. Forum.