A variable baseline stereoscopic camera with fast deployable structure for natural orifice transluminal endoscopic surgery

Purpose Stereo vision can provide surgeons with 3D images and reduce the difficulty of operation in robot-assisted surgery. In natural orifice transluminal endoscopic surgery, distortions of the stereoscopic images could be induced at different observation depths. This would increase the risk of surgery. We proposed a novel camera to solve this problem. Methods This study integrated the camera calibration matrix and the geometric model of stereoscopic system to find the cause of distortion. It was found that image distortions were caused by inappropriate disparity, and this could be avoided by changing the camera baseline. We found the relationship between camera baseline and observation depth with the model. A variable baseline stereoscopic camera with deployable structure was designed to achieve this requirement. The baseline could be adjusted to provide appropriate disparity. Results Three controlled experiments were conducted to verify the stereo vision of the proposed camera at different observation depths. No significant difference was observed in the completion time. At the observation depths of 30 mm and 90 mm, the number of errors apparently decreased by 62.90% and 51.06%, respectively. Conclusions The significant decrease in number of errors shows that the proposed camera has a better stereo vision than a regular camera at both small and large observation depths. It can produce more accurate stereoscopic images at any depth. This will further improve the safety of robot-assisted surgery.

[1]  Michael Figl,et al.  Reconstruction of a 3D surface from video that is robust to missing data and outliers: Application to minimally invasive surgery using stereo and mono endoscopes , 2012, Medical Image Anal..

[2]  K. Iwakiri,et al.  Three-dimensional flexible endoscopy enables more accurate endoscopic recognition and endoscopic submucosal dissection marking for superficial gastric neoplasia: a pilot study to compare two- and three-dimensional imaging , 2020, Surgical Endoscopy.

[3]  Stephen R. Ellis,et al.  Effect of reduced stereoscopic camera separation on ring placement with a surgical telerobot , 2008, Surgical Endoscopy.

[4]  Dawei Feng,et al.  Analysis and design of stereoscopic display in stereo television endoscope system , 2008, International Conference on Optical Instruments and Technology.

[5]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[6]  Changhe Zhou,et al.  Miniaturized three-dimensional endoscopic imaging system based on active stereovision. , 2003, Applied optics.

[7]  Apeksha Avinash,et al.  Evaluation of Increasing Camera Baseline on Depth Perception in Surgical Robotics , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Louis B. Rosenberg The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[10]  Julie Pallant,et al.  SPSS survival manual : a step by step guide to data analysis using SPSS for Windows , 2001, Behaviour Change.

[11]  Apeksha Avinash,et al.  A “pickup” stereoscopic camera with visual-motor aligned control for the da Vinci surgical system: a preliminary study , 2019, International Journal of Computer Assisted Radiology and Surgery.

[12]  M. Meng,et al.  ROBOTICS IN NATURAL ORIFICE TRANSLUMINAL ENDOSCOPIC SURGERY , 2013 .

[13]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[14]  Kai Xu,et al.  A foldable stereo vision unit for Single Port Access Laparoscopy , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[16]  Hongliang Ren,et al.  Open-Source Development of a Low-Cost Stereo-Endoscopy System for Natural Orifice Transluminal Endoscopic Surgery , 2017, ICVS.

[17]  Piet C. de Groen,et al.  History of the Endoscope [Scanning Our Past] , 2017, Proc. IEEE.

[18]  Polly Yeung,et al.  SPSS survival manual. A step by step guide to data analysis using IBM SPSS (5th ed) [Book Review] , 2014 .

[19]  Bin Zheng,et al.  Depth Perception of Surgeons in Minimally Invasive Surgery , 2016, Surgical innovation.

[20]  Makoto Hashizume,et al.  New Advances in Three-Dimensional Endoscopic Surgery , 2013 .

[21]  Derek H. Fender,et al.  Human Engineering in Stereoscopic Viewing Devices , 1993, Advances in Computer Vision and Machine Intelligence.

[22]  M P Schijven,et al.  Laparoscopic skills training using inexpensive box trainers: which exercises to choose when constructing a validated training course , 2011, BJOG : an international journal of obstetrics and gynaecology.

[23]  John Kenneth Salisbury,et al.  Comparison of Three High-End Endoscopic Visualization Systems on Telesurgical Performance , 2000, MICCAI.