Fast Image Mapping of Endoscopic Image Mosaics with Three-Dimensional Ultrasound Image for Intrauterine Treatment of Twin-to-Twin Transfusion Syndrome

This paper describes a fast image mapping system that integrates endoscopic image mosaics with three-dimensional (3-D) ultrasound images for assisting intrauterine treatment of twin-to-twin transfusion syndrome (TTTS) by laser photocoagulation. Endoscopic laser photocoagulation treatment has a good survival rate and a low complication rate for twins. However, the small field of view and lack of surrounding information makes the identification of vessels anastomosis difficult. We have developed an extended placenta visualization system with the fusion of endoscopic image mosaics with a 3-D ultrasound-image placenta model. Fully automatic and fast calibration is used for endoscope calibration in fluid. The 3-D spatial position of the endoscopic images and the ultrasound image are tracked by a 3-D position tracking device. The mosaiced endoscope images are registered to the surface of the 3-D ultrasound placenta model by using a fast GPU-based image rendering method. Experimental results show that the system may provide an improved and efficient way of planning and guidance in laser photocoagulation TTTS treatment.

[1]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[2]  T. Anderson,et al.  Placental pathophysiology of the twin oligohydramnios-polyhydramnios sequence and the twin-twin transfusion syndrome. , 1998, Placenta.

[3]  Jake K. Aggarwal,et al.  A simple calibration procedure for fish-eye (high distortion) lens camera , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[4]  Paul S. Heckbert,et al.  Survey of Texture Mapping , 1986, IEEE Computer Graphics and Applications.

[5]  Nobuhiko Hata,et al.  Scalable high-resolution integral videography autostereoscopic display with a seamless multiprojection system. , 2005, Applied optics.

[6]  J P Bruner,et al.  Twin-to-twin transfusion syndrome: a subset of the twin oligohydramnios-polyhydramnios sequence. , 1993, American journal of obstetrics and gynecology.

[7]  Philippe C. Cattin,et al.  Mosaicing of Endoscopic Placenta Images , 2006, GI Jahrestagung.

[8]  Terry M. Peters,et al.  Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: creating stereoscopic panoramas , 2002, IEEE Transactions on Medical Imaging.

[9]  Terry M. Peters,et al.  Real-time fusion of endoscopic views with dynamic 3-D cardiac images: a phantom study , 2005, IEEE Transactions on Medical Imaging.

[10]  R. Quintero,et al.  Selective versus non‐selective laser photocoagulation of placental vessels in twin‐to‐twin transfusion syndrome , 2000, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[11]  Mubarak Shah,et al.  A Fast algorithm for active contours and curvature estimation , 1992, CVGIP Image Underst..

[12]  J E De Lia,et al.  Fetoscopic neodymium: Yag laser occlusion of placental vessels in severe twin‐twin transfusion syndrome , 1990, Obstetrics and gynecology.

[13]  M. Hansmann,et al.  Endoscopic laser surgery versus serial amniocenteses in the treatment of severe twin-twin transfusion syndrome. , 1999, American journal of obstetrics and gynecology.