Correspondence-Steered Volumetric Descriptor Learning Using Deep Functional Maps

In this paper, we consider the dense correspondence of volumetric images and propose a convolutional network-based descriptor learning framework using the functional map representation. Our main observation is that the correspondence-steered descriptor learning improves dense volumetric mapping compared with the hand-crafted descriptors. We present an unsupervised way to find the optimal network parameters by aligning volumetric probe functions and the enforcement of invertible coupled maps. The proposed framework takes the one-channel volume as input and outputs the multi-channel volumetric descriptors using the cascaded convolutional operators, which are faster than the conventional descriptor computations. We follow the deep functional map framework and represent the dense correspondence by the low-dimensional spectral mapping for the functional transfer and dense correspondence using the linear algebra. We demonstrate that by using the correspondence-steered deep descriptor learning, the quality of both the dense correspondence and attribute transfer are improved in the extensive experiments.

[1]  Hongbin Zha,et al.  Consistent Correspondence of Cone-Beam CT Images Using Volume Functional Maps , 2018, MICCAI.

[2]  Nicholas Ayache,et al.  Brain Transfer: Spectral Analysis of Cortical Surfaces and Functional Maps , 2015, IPMI.

[3]  Leonidas J. Guibas,et al.  Image Co-segmentation via Consistent Functional Maps , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Alexander M. Bronstein,et al.  Deep Functional Maps: Structured Prediction for Dense Shape Correspondence , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Ben Glocker,et al.  Supervoxel Classification Forests for Estimating Pairwise Image Correspondences , 2015, MLMI.

[6]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Hongbin Zha,et al.  Superimposition of Cone-Beam Computed Tomography Images by Joint Embedding , 2017, IEEE Transactions on Biomedical Engineering.

[8]  Maks Ovsjanikov,et al.  Functional maps , 2012, ACM Trans. Graph..

[9]  Vladimir Pekar,et al.  Full orientation invariance and improved feature selectivity of 3D SIFT with application to medical image analysis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Stefan Freitag,et al.  VolHOG: a volumetric object recognition approach based on bivariate histograms of oriented gradients for vertebra detection in cervical spine MRI. , 2014, Medical physics.

[11]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[12]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[13]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[14]  Michael Brady,et al.  Towards Realtime Multimodal Fusion for Image-Guided Interventions Using Self-similarities , 2013, MICCAI.