A Novel Reconstruction Model of Multi-camera Positioning System Based on Neural Network

Optical positioning based on multiple cameras could obtain superior performance with large measuring volume and excellent accuracy, and is therefore widely employed in medical robotics, especially in surgical robotics. The optical positioning precision highly depends on the three-dimensional (3D) reconstruction model, and the traditional Euclidean reconstruction is tanglesome in calibration and is time-consuming for a real-time system. This paper proposed a novel Radial Basis Function Neural Network (RBFNN)-based reconstruction model without complicated calibration and with the capacity of approximating nonlinear functions for multi-camera positioning system (MCPS). Moreover, a special image pre-processing was also proposed for improving the stability and precision of RBFNN-based reconstruction model. The experimental results revealed the proposed reconstruction model could achieve superior performance with accuracy of 0.2676mm and is robust in both static and dynamic scenarios.

[1]  Yongqiang Feng,et al.  Accuracy and precision of a custom camera-based system for 2-d and 3-d motion tracking during speech and nonspeech motor tasks. , 2014, Journal of speech, language, and hearing research : JSLHR.

[2]  Zheng Li,et al.  Design and prototyping of a soft magnetic anchored and guidance endoscope system , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Guang-Zhong Yang,et al.  Autonomous scanning for endomicroscopic mosaicing and 3D fusion , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Yu-Hwa Lo,et al.  Bio-inspired fluidic lens surgical camera for MIS , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Apurba Das,et al.  A concise review of fast bilateral filtering , 2017, 2017 Fourth International Conference on Image Information Processing (ICIIP).

[6]  Hongliang Ren,et al.  Passive Markers for Tracking Surgical Instruments in Real-Time 3-D Ultrasound Imaging , 2012, IEEE Transactions on Medical Imaging.

[7]  Chao Hu,et al.  Investigation of the Relationship Between Tracking Accuracy and Tracking Distance of a Novel Magnetic Tracking System , 2017, IEEE Sensors Journal.

[8]  Max Q.-H. Meng,et al.  6-D Electromagnetic Tracking Approach Using Uniaxial Transmitting Coil and Tri-Axial Magneto-Resistive Sensor , 2018, IEEE Sensors Journal.

[9]  Rongqian Yang,et al.  Design of an Accurate Near Infrared Optical Tracking System in Surgical Navigation , 2013, Journal of Lightwave Technology.

[10]  Jindong Tan,et al.  Design of a unified active locomotion mechanism for a capsule-shaped laparoscopic camera system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Jindong Tan,et al.  Initial design and results of an untethered insertable laparoscopic robotic surgical camera system , 2017, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[12]  David J. Kriegman,et al.  Practical Global Optimization for Multiview Geometry , 2006, ECCV.

[13]  Sébastien Ourselin,et al.  Accurate Localization of Optic Radiation During Neurosurgery in an Interventional MRI Suite , 2012, IEEE Transactions on Medical Imaging.

[14]  Wei Liu,et al.  Marker-Based Surgical Instrument Tracking Using Dual Kinect Sensors , 2013, IEEE Transactions on Automation Science and Engineering.

[15]  Adrien Bartoli.  A unified framework for quasi-linear bundle adjustment , 2002, Object recognition supported by user interaction for service robots.

[16]  Teng Long,et al.  Fast and Robust RBF Neural Network Based on Global K-Means Clustering With Adaptive Selection Radius for Sound Source Angle Estimation , 2018, IEEE Transactions on Antennas and Propagation.

[17]  Chao Hu,et al.  Simple 3-D Point Reconstruction Methods With Accuracy Prediction for Multiocular System , 2013, IEEE/ASME Transactions on Mechatronics.

[18]  Stefano Tubaro,et al.  Postural Assessment in Dentistry Based on Multiple Markers Tracking , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[19]  Max Q.-H. Meng,et al.  Marker-based quadri-ocular tracking system for surgery , 2012 .

[20]  Ning Li,et al.  Hardware design for a cable-free fully insertable wireless laparoscopic robotic camera. , 2016, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[21]  Blake Hannaford,et al.  Towards real-time surface tracking and motion compensation integration for robotic surgery , 2017, 2017 IEEE/SICE International Symposium on System Integration (SII).

[22]  Bangjiang Lin,et al.  A VLC Smartphone Camera Based Indoor Positioning System , 2018, IEEE Photonics Technology Letters.

[23]  Qingxiang Wu,et al.  A 3D passive optical localization system based on binocular infrared cameras , 2016, 2016 IEEE International Conference on Information and Automation (ICIA).