Development of Real-Time 3D Navigation System for Intra-operative Information by Integral Videography

A real-time surgical navigation system that superimposes the real, intuitive 3D image for medical diagnosis and operation was developed. This system creates 3D image based on the principle of integral photography, named “Integral Videography”, which can be observed following the operator’s movement of the field of vision via a half-mirror as if they could be seen through the body. Moreover, a real-time IV algorithm for calculating the 3D image of surgical instruments was used for registration between the location of surgical instruments and the organ during the operation. The experimental results of sticking a point location and avoiding dangerous area show the errors of this navigation system were in the range of 2~3mm. Because of the simplicity and the accuracy of real-time projected point location, this system will be practically usable in the medical field.