Computer assisted system for precise lung surgery based on medical image computing and mixed reality

The key of a surgical treatment for the lung cancer is to remove the infected part with the least excision and to retain most of the healthy lung tissue. The traditional computer surgery assisted system show that the patient’s CT images or three-dimensional structure in the PC screen. This assisted system is not a real three-dimensional system and can’t display well the position of pulmonary vessels and trachea of the patients to surgeon. To solve the problem, a computer assisted system for precise lung surgery for precise surgery based on medical image and VR is developed in this paper. Firstly, the regional growth and filling algorithm is designed to segment lung trachea and lung vessels. Then, the reference edge grid algorithm is used to construct the model of the segmentation trachea and lung vessels. And the models are saved as an identifiable STL type file. Finally, according to the system analysis for the specific system function, the computer assisted system is implemented to display the three-dimensional pulmonary vessels and trachea on the mixed reality device. The surgeons can observe and interface precisely the real three-dimensional lung structure of the patient to help them operate accurately the lung surgery.

[1]  Marc Olano,et al.  Isosurface smoothing using marching cubes and PN-triangles , 2015, I3D.

[2]  Xiuzhen Zhang,et al.  A probabilistic method for emerging topic tracking in Microblog stream , 2016, World Wide Web.

[3]  Jinli Cao,et al.  A computer aided analysis scheme for detecting epileptic seizure from EEG data , 2018, Int. J. Comput. Intell. Syst..

[4]  Alessandro Ricci,et al.  The Mirror World: Preparing for Mixed-Reality Living , 2015, IEEE Pervasive Computing.

[5]  Luo Xinggang,et al.  Medical Image Segmentation Based on Improved Ostu Algorithm and Regional Growth Algorithm , 2006 .

[6]  Bin Zhou,et al.  Multi-window based ensemble learning for classification of imbalanced streaming data , 2015, World Wide Web.

[7]  Yanchun Zhang,et al.  Mining Event-Oriented Topics in Microblog Stream with Unsupervised Multi-View Hierarchical Embedding , 2018, ACM Trans. Knowl. Discov. Data.

[8]  Glyn Lawson,et al.  Empirical evidence, evaluation criteria and challenges for the effectiveness of virtual and mixed reality tools for training operators of car service maintenance , 2015, Comput. Ind..

[9]  Jiejie Zhu,et al.  Virtual Reality and Mixed Reality for Virtual Learning Environments , 2006, Edutainment.

[10]  Yanchun Zhang,et al.  Parallelization of Massive Textstream Compression Based on Compressed Sensing , 2017, ACM Trans. Inf. Syst..

[11]  Yanchun Zhang,et al.  Item Group Recommendation: A Method Based on Game Theory , 2017, WWW.

[12]  S. Armato,et al.  Automated lung segmentation for thoracic CT impact on computer-aided diagnosis. , 2004, Academic radiology.

[13]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[14]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.