Mosaicing of Confocal Microscopic In Vivo Soft Tissue Video Sequences

Fibered confocal microscopy allows in vivo and in situ imaging with cellular resolution. The potentiality of this imaging modality is extended in this work by using video mosaicing techniques. Two novelties are introduced. A robust estimator based on statistics for Riemannian manifolds is developed to find a globally consistent mapping of the input frames to a common coordinate system. A mosaicing framework using an efficient scattered data fitting method is proposed in order to take into account the non-rigid deformations and the irregular sampling implied by in vivo fibered confocal microscopy. Results on 50 images of a live mouse colon demonstrate the effectiveness of the proposed method.

[1]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Bernd Neumann,et al.  Computer Vision — ECCV’98 , 1998, Lecture Notes in Computer Science.

[4]  Pierre Hellier,et al.  Level Set Methods in an EM Framework for Shape Classification and Estimation , 2004, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[5]  Nicholas Ayache,et al.  Towards Optical Biopsies with an Integrated Fibered Confocal Fluorescence Microscope , 2004, MICCAI.

[6]  Branislav Jaramaz,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2000 , 2000, Lecture Notes in Computer Science.

[7]  Charles V. Stewart,et al.  A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Sébastien Ourselin,et al.  Block Matching: A General Framework to Improve Robustness of Rigid Registration of Medical Images , 2000, MICCAI.

[9]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[10]  P. Anandan,et al.  Mosaic based representations of video sequences and their applications , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Xavier Pennec,et al.  Probabilities and statistics on Riemannian manifolds: Basic tools for geometric measurements , 1999, NSIP.

[12]  Harpreet S. Sawhney,et al.  Robust Video Mosaicing through Topology Inference and Local to Global Alignment , 1998, ECCV.