Real-Time Image Mosaicing for Medical Applications

In this paper we describe the development of a robotically-assisted image mosaicing system for medical applications. The processing occurs in real-time due to a fast initial image alignment provided by robotic position sensing. Near-field imaging, defined by relatively large camera motion, requires translations as well as pan and tilt orientations to be measured. To capture these measurements we use 5-d.o.f. sensing along with a hand-eye calibration to account for sensor offset. This sensor-based approach speeds up the mosaicing, eliminates cumulative errors, and readily handles arbitrary camera motions. Our results have produced visually satisfactory mosaics on a dental model but can be extended to other medical images.

[1]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[2]  F Vogt,et al.  Light fields for minimal invasive surgery using an endoscope positioning robot. , 2004, Methods of information in medicine.

[3]  S. D. Fleischer,et al.  Global position determination and vehicle path estimation from a vision sensor for real-time video mosaicking and navigation , 1997, Oceans '97. MTS/IEEE Conference Proceedings.

[4]  M E Martone,et al.  Automated microscopy system for mosaic acquisition and processing , 2006, Journal of microscopy.

[5]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[6]  Borivoj Vojnovic,et al.  An Algorithm for image stitching and blending , 2005, SPIE BiOS.

[7]  B. Wilson,et al.  Optical techniques for the endoscopic detection of dysplastic colonic lesions , 2005, Current opinion in gastroenterology.

[8]  Nicholas Ayache,et al.  Mosaicing of Confocal Microscopic In Vivo Soft Tissue Video Sequences , 2005, MICCAI.

[9]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[10]  David B. Camarillo,et al.  Robotic technology in surgery: past, present, and future. , 2004, American journal of surgery.

[11]  Masakatsu Kourogi,et al.  Fast Panoramic Image Mosaicing Using One-dimensional Flow Estimation , 2002, Real Time Imaging.

[12]  Desney S. Tan,et al.  Panoramic viewfinder: providing a real-time preview to help users avoid flaws in panoramic pictures , 2005, OZCHI.

[13]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..