Multiscale Anisotropic Harmonic Filters on non Euclidean domains

This paper introduces Multiscale Anisotropic Harmonic Filters (MAHFs) aimed at extracting signal variations over non-Euclidean domains, namely 2D-Manifolds and their discrete representations, such as meshes and 3D Point Clouds as well as graphs. The topic of pattern analysis is central in image processing and, considered the growing interest in new domains for information representation, the extension of analogous practices on volumetric data is highly demanded. To accomplish this purpose, we define MAHFs as the product of two components, respectively related to a suitable smoothing function, namely the heat kernel derived from the heat diffusion equations, and to local directional information. We analyse the accuracy of our approach in multi-scale filtering and variation extraction. Finally, we present an application to the surface normal field and to a luminance signal textured to a mesh, aiming to spot, in a separate fashion, relevant curvature changes (support variations) and signal variations.

[1]  J. Sochor,et al.  Introducing the FIDENTIS 3D Face Database , 2018, Anthropological Review.

[2]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[3]  Hong Qin,et al.  Continuous and discrete Mexican hat wavelet transforms on manifolds , 2012, Graph. Model..

[4]  Bruno Lévy,et al.  Spectral Geometry Processing with Manifold Harmonics , 2008, Comput. Graph. Forum.

[5]  Giovanni Jacovitti,et al.  Multiresolution circular harmonic decomposition , 2000, IEEE Trans. Signal Process..

[6]  Shih-Gu Huang,et al.  Fast Polynomial Approximation of Heat Kernel Convolution on Manifolds and Its Application to Brain Sulcal and Gyral Graph Pattern Analysis , 2020, IEEE Transactions on Medical Imaging.

[7]  Elmar Eisemann,et al.  CNNs on surfaces using rotation-equivariant features , 2020, ACM Trans. Graph..

[8]  Pierre Vandergheynst,et al.  Fourier could be a data scientist: From graph Fourier transform to signal processing on graphs , 2019, Comptes Rendus Physique.

[9]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[10]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[11]  Ivan V. Bajic,et al.  3D Point Cloud Super-Resolution via Graph Total Variation on Surface Normals , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[12]  Pierre Vandergheynst,et al.  Geodesic Convolutional Neural Networks on Riemannian Manifolds , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[13]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[14]  Stefania Colonnese,et al.  Fast image interpolation using Circular Harmonic Functions , 2010, 2010 2nd European Workshop on Visual Information Processing (EUVIP).

[15]  Max Welling,et al.  Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphs , 2020, ICLR.

[16]  M. Ovsjanikov,et al.  Wavelet‐based Heat Kernel Derivatives: Towards Informative Localized Shape Analysis , 2020, Comput. Graph. Forum.

[17]  Pascal Frossard,et al.  Graph-Based Compression of Dynamic 3D Point Cloud Sequences , 2015, IEEE Transactions on Image Processing.

[18]  Anqi Qiu,et al.  Spectral Laplace-Beltrami Wavelets With Applications in Medical Images , 2015, IEEE Transactions on Medical Imaging.

[19]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[20]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[21]  Toshiaki Koike-Akino,et al.  HoloCast: Graph Signal Processing for Graceful Point Cloud Delivery , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[22]  Patrizio Campisi,et al.  Multichannel blind image deconvolution using the Bussgang algorithm: spatial and multiresolution approaches , 2003, IEEE Trans. Image Process..

[23]  Giuseppe Patanè,et al.  Heat diffusion kernel and distance on surface meshes and point sets , 2013, Comput. Graph..

[24]  Guillermo Sapiro,et al.  A Gromov-Hausdorff Framework with Diffusion Geometry for Topologically-Robust Non-rigid Shape Matching , 2010, International Journal of Computer Vision.

[25]  Tsz Wai Wong,et al.  Geometric understanding of point clouds using Laplace-Beltrami operator , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.