Probabilistic Point Cloud Reconstructions for Vertebral Shape Analysis

We propose an auto-encoding network architecture for point clouds (PC) capable of extracting shape signatures without supervision. Building on this, we (i) design a loss function capable of modelling data variance on PCs which are unstructured, and (ii) regularise the latent space as in a variational auto-encoder, both of which increase the auto-encoders' descriptive capacity while making them probabilistic. Evaluating the reconstruction quality of our architectures, we employ them for detecting vertebral fractures without any supervision. By learning to efficiently reconstruct only healthy vertebrae, fractures are detected as anomalous reconstructions. Evaluating on a dataset containing $\sim$1500 vertebrae, we achieve area-under-ROC curve of $>$75%, without using intensity-based features.

[1]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[2]  Sungzoon Cho,et al.  Variational Autoencoder based Anomaly Detection using Reconstruction Probability , 2015 .

[3]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[4]  Dong Tian,et al.  FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  C. Lorenz,et al.  Automatic detection of osteoporotic vertebral fractures in routine thoracic and abdominal MDCT , 2014, European Radiology.

[6]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[8]  Alex R. Smith,et al.  Sex differences in the structural connectome of the human brain , 2013, Proceedings of the National Academy of Sciences.

[9]  Samuel Kadoury,et al.  Deep Spectral-Based Shape Features for Alzheimer's Disease Classification , 2016, SeSAMI@MICCAI.

[10]  Saeed Hassanpour,et al.  Deep neural networks for automatic detection of osteoporotic vertebral fractures on CT scans , 2018, Comput. Biol. Medicine.

[11]  Christian Wachinger,et al.  Deep Multi-Structural Shape Analysis: Application to Neuroanatomy , 2018, MICCAI.

[12]  Hao Su,et al.  A Point Set Generation Network for 3D Object Reconstruction from a Single Image , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).