Registration and fusion of 3D surface data from CT and ToF camera for position verification in radiotherapy

The purpose of this study is to introduce a low-cost method for verification of patient positioning before and during irradiation in radiotherapy. The experiments strategy is implemented by using a phantom like a human head in two modes: with and without thermoplastic masks. Radiotherapy is an effective clinical option for topical tumors treatment. Ability to the monitoring and control the patient’s position during treatment is among the important items in radiotherapy. We registered to modality of 3D surface image in point cloud format, dynamic 3D image of time-of-flight camera (includes outer shape of head) and static 3D image of CT slice sectional by coherent point drift algorithm. Accuracy of 3D surface registration was calculated by average symmetrical surface distances (ASD) that it is a new method based on surface distance. The mean ASD calculated for rotation around X and Y axes of phantom is 2.62 ± 0.97 mm with immobilized thermoplastic mask and accuracy be increased to 1.69 ± 0.88 mm in non-thermoplastic mode. By performing paired T tests for ASDs, it was found that the use of a thermoplastic mask does not make a significant difference in the data acquisition. By developing this research to image fusion of that’s 3D data sets, we will design to augmented reality in radiotherapy for verification of treatment planning and compare it with the electronic portal imaging device.

[1]  Tobias Ortmaier,et al.  Accuracy Identification of Markerless Registration with the DLR Handheld 3D-Modeller in Medical Applications , 2007 .

[2]  L. Joskowicz,et al.  Surface-based facial scan registration in neuronavigation procedures: a clinical study. , 2009, Journal of neurosurgery.

[3]  W. Schlegel,et al.  Accuracy of a commercial optical 3D surface imaging system for realignment of patients for radiotherapy of the thorax , 2007, Physics in medicine and biology.

[4]  Jakob Wasza,et al.  Automatic Multi-modal ToF/CT Organ Surface Registration , 2011, Bildverarbeitung für die Medizin.

[5]  Sven Haase,et al.  Multi-modal surface registration for markerless initial patient setup in radiation therapy using microsoft's Kinect sensor , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[6]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Mehran Yazdi,et al.  A lossless data hiding scheme for medical images using a hybrid solution based on IBRW error histogram computation and quartered interpolation with greedy weights , 2018, Neural Computing and Applications.

[8]  Susan M. Astley,et al.  Evaluation of Kinect 3D Sensor for Healthcare Imaging , 2016, Journal of medical and biological engineering.

[9]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[10]  C. Belka,et al.  Evaluation of daily patient positioning for radiotherapy with a commercial 3D surface-imaging system (Catalyst™) , 2016, Radiation Oncology.

[11]  Mehran Yazdi,et al.  Robust cascaded skin detector based on AdaBoost , 2018, Multimedia Tools and Applications.

[12]  Luc Soler,et al.  A structured light system to guide percutaneous punctures in interventional radiology , 2008, SPIE Photonics Europe.

[13]  Jinkoo Kim,et al.  Characteristics of a novel treatment system for linear accelerator–based stereotactic radiosurgery , 2015, Journal of applied clinical medical physics.

[14]  Robert J. Maciunas,et al.  Registration of head CT images to physical space using a weighted combination of points and surfaces [image-guided surgery] , 1998, IEEE Transactions on Medical Imaging.

[15]  Elli Angelopoulou,et al.  Fast time-of-flight camera based surface registration for radiotherapy patient positioning. , 2011, Medical physics.

[16]  Rafael Verdú,et al.  Erratum to: DRR and Portal Image Registration for Automatic Patient Positioning in Radiotherapy Treatment , 2014, Journal of Digital Imaging.

[17]  Lena Maier-Hein,et al.  Real-Time Range Imaging in Health Care: A Survey , 2013, Time-of-Flight and Depth Imaging.

[18]  Nasser Kehtarnavaz,et al.  Affine invariant comparison of point-sets using convex hulls and hausdorff distances , 2007, Pattern Recognit..

[19]  Vivek Aggarwal,et al.  Integrating Morphological Edge Detection and Mutual Information for Nonrigid Registration of Medical Images. , 2019, Current medical imaging reviews.

[20]  Joachim Hornegger,et al.  Time-of-Flight sensor for patient positioning , 2009, Medical Imaging.

[21]  Lixu Gu,et al.  A robust automated markerless registration framework for neurosurgery navigation , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.

[22]  Lena Maier-Hein,et al.  Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery , 2013, Medical Image Anal..

[23]  Rasmus Larsen,et al.  Motion Tracking for Medical Imaging: A Nonvisible Structured Light Tracking Approach , 2012, IEEE Transactions on Medical Imaging.

[24]  Mohammad Reza Khosravi.  Single- and Multi-Step Image Enlargement for Medical Image Coding , 2020 .

[25]  Zahra Rabbani,et al.  Classification of Medical Image Modeling Methods: A Review , 2016 .

[26]  V. Seifert,et al.  Laser Surface Scanning for Patient Registration in Intracranial Image-guided Surgery , 2002, Neurosurgery.

[27]  Branko Karan.  Calibration of Kinect-type RGB-D sensors for robotic applications , 2015 .

[28]  Ravinder Kaur and Mamta Juneja.  A Survey of Kidney Segmentation Techniques in CT Images , 2016 .

[29]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[30]  Real-time Dash Streaming Architecture for Internet of Things Using FBMRWP Model for Medical Videos. , 1969, Current medical imaging reviews.

[31]  Wei Liu,et al.  Image Registration Technique Based on a Fast CPD Algorithm , 2015 .

[32]  Hideaki Haneishi,et al.  Development of fast patient position verification software using 2D-3D image registration and its clinical experience , 2015, Journal of radiation research.

[33]  M. Al-Berry,et al.  3D Visualization of Brain Tumors Using MR Images: A Survey. , 2019, Current medical imaging reviews.

[34]  Mohammad Reza Khosravi,et al.  Medical Image Magnification Based on Original and Estimated Pixel Selection Models. , 2018 .

[35]  Muhammad A. Jaffar.  Quantum Noise Removal from Breast Mammograms Using Genetic Programming based Hybrid Ensemble Filter , 2016 .

[36]  Darren Kahler,et al.  Characterization of a real-time surface image-guided stereotactic positioning system. , 2010, Medical physics.

[37]  Rafael Verdú,et al.  DRR and Portal Image Registration for Automatic Patient Positioning in Radiotherapy Treatment , 2011, Journal of Digital Imaging.

[38]  J Schlaier,et al.  Registration accuracy and practicability of laser-directed surface matching. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[39]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.