Real time tracking of 3D organ surfaces using single MR image and limited optical viewing

This paper presents the first demonstration of real time 3D tracking of organ deformation based on one-sided, limited view needlescopic optical imaging and a single pre-operative MRI/CT scan. The reconstruction is based on the empirical observation that the spherical harmonic coefficients corresponding to distorted surfaces of any given organ lie in lower dimensional spaces that can be learned during training. The paper discusses the details of the selection of the limited optical views and the registration of the real time partial optical images with the single pre-operative MRI/CT scan. Finally, it demonstrates the first experimental 3D reconstruction of ex-vivo kidneys based on a single MRI scan with 1 mm resolution and real time single side optical imagery achieving spatial resolution of better than 2 mm, even on the hidden organ surface, or less than 1.85% relative error.

[1]  Dan Wang,et al.  Real time tracking of exterior and interior organ surfaces using sparse sampling of the exterior surfaces , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Luca Ballan,et al.  Multimodal 3D Shape Recovery from Texture, Silhouette and Shadow Information , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[3]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[4]  Amir A. Amini,et al.  Fast LV motion estimation using subspace approximation techniques , 2001, IEEE Transactions on Medical Imaging.

[5]  Dan Wang,et al.  In vivo tracking of 3D organs using spherical harmonics and subspace clustering , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  James A. Sethian,et al.  A real-time algorithm for medical shape recovery , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Dan Wang,et al.  Sparse representation of deformable 3D organs , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jean-Louis Dillenseger,et al.  Spherical Harmonics Based Intrasubject 3-D Kidney Modeling/Registration Technique Applied on Partial Information , 2006, IEEE Transactions on Biomedical Engineering.

[10]  M. McPeek,et al.  Modeling Three-Dimensional Morphological Structures Using Spherical Harmonics , 2009, Evolution; international journal of organic evolution.