The Use of Super Resolution in Robotic Assisted Minimally Invasive Surgery

In minimally invasive surgery, a small field-of-view is often required for achieving a large magnification factor during micro-scale tasks such as coronary anastomosis. Constant change of the orientation and focal length of the laparoscope camera, however, is cumbersome and can impose extra visual and cognitive load to the operating surgeon in realigning the visual pathways and anatomical landmarks. The purpose of this paper is to investigate the use of fixational movements for robotic assisted minimal invasive surgery such that the perceived resolution of the foveal field-of-view is greater than the intrinsic resolution of the laparoscope camera. The proposed technique is based on super resolution imaging using projection onto convex sets. Validation with both phantom and in vivo data from totally endoscopic coronary artery bypass surgery is provided.

[1]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[2]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[3]  B. Davies,et al.  Robotic surgery , 1993, IEEE Engineering in Medicine and Biology Magazine.

[4]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[5]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[6]  Guang-Zhong Yang,et al.  Gaze Contingent Depth Recovery and Motion Stabilisation for Minimally Invasive Robotic Surgery , 2004, MIAR.

[7]  Min-Cheol Hong,et al.  An iterative weighted regularized algorithm for improving the resolution of video sequences , 1997, Proceedings of International Conference on Image Processing.

[8]  Guang-Zhong Yang,et al.  Gaze-Contingent Soft Tissue Deformation Tracking for Minimally Invasive Robotic Surgery , 2005, MICCAI.

[9]  Lawrence W. Stark,et al.  Sensing and Manipulation Problems in Endoscopic Surgery: Experiment, Analysis, and Observation , 1993, Presence: Teleoperators & Virtual Environments.

[10]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  A. Murat Tekalp,et al.  High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.