Probabilistic Surface Reconstruction with Unknown Correspondence

We frequently encounter the need to reconstruct the full 3D surface from a given part of a bone in areas such as orthopaedics and surgical planning. Once we establish correspondence between the partial surface and a Statistical Shape Model (SSM), the problem has an appealing solution. The most likely reconstruction, as well as the full posterior distribution of all possible surface completions, can be obtained in closed form with an SSM. In this paper, we argue that assuming known correspondence is unjustified for long bones. We show that this can lead to reconstructions, which greatly underestimate the uncertainty. Even worse, the ground truth solution is often deemed very unlikely under the posterior. Our main contribution is a method which allows us to estimate the posterior distribution of surfaces given partial surface information without making any assumptions about the correspondence. To this end, we use the Metropolis-Hastings algorithm to sample reconstructions with unknown pose and correspondence from the posterior distribution. We introduce a projection-proposal to propose shape and pose updates to the Markov-Chain, which lets us explore the posterior distribution much more efficiently than a standard random-walk proposal. We use less than 1% of the samples needed by a random-walk to explore the posterior. We compare our method with the analytically computed posterior distribution, which assumes fixed correspondence. The comparison shows that our method leads to much more realistic posterior estimates when only small fragments of the bones are available.

[1]  Zhonglin Zhu,et al.  Construction of 3D human distal femoral surface models using a 3D statistical deformable model. , 2011, Journal of biomechanics.

[2]  Tiangang Cui,et al.  Dimension-independent likelihood-informed MCMC , 2014, J. Comput. Phys..

[3]  Nicholas Ayache,et al.  Rigid, affine and locally affine registration of free-form surfaces , 1996, International Journal of Computer Vision.

[4]  Gábor Székely,et al.  Conditional Variability of Statistical Shape Models Based on Surrogate Variables , 2009, MICCAI.

[5]  Ruma Purkait,et al.  Triangle identified at the proximal end of femur: a new sex determinant. , 2005, Forensic science international.

[6]  Johan Thunberg,et al.  Shape‐aware surface reconstruction from sparse 3D point‐clouds , 2016, Medical Image Anal..

[7]  G. Gleser,et al.  Estimation of stature from long bones of American Whites and Negroes. , 1952, American journal of physical anthropology.

[8]  Martin Styner,et al.  Accurate and Robust Reconstruction of a Surface Model of the Proximal Femur From Sparse-Point Data and a Dense-Point Distribution Model for Surgical Navigation , 2007, IEEE Transactions on Biomedical Engineering.

[9]  Thomas Vetter,et al.  Posterior shape models , 2013, Medical Image Anal..

[10]  Thomas Vetter,et al.  Probabilistic Fitting of Active Shape Models , 2018, ShapeMI@MICCAI.

[11]  Adam Kortylewski,et al.  Informed MCMC with Bayesian Neural Networks for Facial Image Analysis , 2018, ArXiv.

[12]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[13]  Andreas Morel-Forster,et al.  A Closest Point Proposal for MCMC-based Probabilistic Surface Registration , 2019, ECCV.