We have been developing a liver surgical support system. By matching the depth images of the real liver and the 3D liver model during surgery, the position of the liver, invisible blood vessels and tumors is estimated. The tip position of the surgical knife is measured by single point measurements camera using specific markers. By merging all information, the distance between the knife tip and the target parts such as vessels or tumors is calculated and the proximity of the knife to the target parts is determined. To indicate the proximity, we have been developing a surgical knife attachment with light emitting diodes (LEDs). When the knife approaches to the target parts, the LEDs on the attachment gradually turn on the light. The newly developed attachment becomes compact and lightweight than the previous one. It uses a wireless controller and ArUco markers which can be tracked by an inexpensive USB camera. We conducted experiments to check the performance of ArUco markers and the navigation of the operator using the new attachment. The results showed the new attachment had comparable navigation accuracy to the previous one.
[1]
Kaoru Watanabe,et al.
Virtual Liver Surgical Simulator by Using Z-Buffer for Object Deformation
,
2015,
HCI.
[2]
Francisco José Madrid-Cuevas,et al.
Automatic generation and detection of highly reliable fiducial markers under occlusion
,
2014,
Pattern Recognit..
[3]
Masanao Koeda,et al.
Experimental Results of 2 D Depth-Depth Matching Algorithm Based on Depth Camera Kinect v 1
,
2016
.
[4]
Masanao Koeda,et al.
Development of a Surgical Knife Attachment with Proximity Indicators
,
2017,
HCI.
[5]
Kaoru Watanabe,et al.
A New Organ-Following Algorithm Based on Depth-Depth Matching and Simulated Annealing, and Its Experimental Evaluation
,
2017,
HCI.
[6]
Kaoru Watanabe,et al.
Experimental results of 2D depth-depth matching algorithm based on depth camera Kinect v1
,
2015,
2015 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS).