3D Tracking and Positioning of Surgical Instruments in Virtual Surgery Simulation

3D tracking and positioning of surgical instruments is an indispensable part of virtual Surgery training system, because it is the unique interface for trainee to communicate with virtual environment. A suit of 3D tracking and positioning of surgical instruments based on stereoscopic vision is proposed. It can capture spatial movements of simulated surgical instrument in real time, and provide 6 degree of freedom information with the absolute error of less than 1 mm. The experimental results show that the 3D tracking and positioning of surgical instruments is highly accurate, easily operated, and inexpensive. Combining with force sensor and embedded acquisition device, this 3D tracking and positioning method can be used as a measurement platform of physical parameters to realize the measurement of soft tissue parameters.

[1]  Coskun Bayrak,et al.  Mixed reality simulation of rasping procedure in artificial cervical disc replacement (ACDR) surgery , 2010, BMC Bioinformatics.

[2]  R.V. Patel,et al.  Design of a sensorized instrument for skills assessment and training in minimally invasive surgery , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[3]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities (2. ed.) , 1997 .

[4]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[5]  Bassma Ghali,et al.  Algorithms for Nonlinear Finite Element-based Modeling of Soft-tissue Deformation and Cutting , 2008 .

[6]  Eric Foxlin,et al.  Motion Tracking Requirements and Technologies , 2002 .

[7]  Cagatay Basdogan,et al.  Real-time visio-haptic interaction with static soft tissue models having geometric and material nonlinearity , 2010, Comput. Graph..

[8]  Armin Kanitsar,et al.  Intra-operative virtual endoscopy for image guided endonasal transsphenoidal pituitary surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[9]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[10]  Joao F Nogueira,et al.  Novel compact laptop‐based image‐guidance system: Preliminary study , 2009, The Laryngoscope.

[11]  Makoto Hashizume,et al.  Objective assessment of laparoscopic suturing skills using a motion-tracking system , 2011, Surgical Endoscopy.

[12]  Changmok Choi,et al.  Graphic and haptic modelling of the oesophagus for VR‐based medical simulation , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[13]  Stefan Wesarg,et al.  VR-Based Simulators for Training in Minimally Invasive Surgery , 2007, IEEE Computer Graphics and Applications.

[14]  Yang Xuan.  REAL-TIME DETECTION AND TRACKING OF LIGHT POINT , 2001 .

[15]  Makoto Hashizume,et al.  Real-time 3-dimensional virtual reality navigation system with open MRI for breast-conserving surgery. , 2010, Journal of the American College of Surgeons.

[16]  Robert D. Howe,et al.  Real-time 3D ultrasound-based servoing of a surgical instrument , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..