Methods to Segment Hard Inclusions in Soft Tissue During Autonomous Robotic Palpation

Localizing tumors and measuring tissue mechanical properties can aid in surgical planning and evaluating the progression of disease. In this paper, autonomous robotic palpation with supervised machine learning algorithms enables mechanical localization and segmentation of stiff inclusions in artificial tissue. Elastography generates training data for the learning algorithms, providing a noninvasive, inclusion-specific characterization of tissue mechanics. Once an embedded hard inclusion was identified in the elastographic image, Gaussian discriminant analysis generated a classifier to threshold stiffness values acquired from autonomous robotic palpation. This classifier was later used to classify newly acquired points as either part of the inclusion or surrounding soft tissue. An expectation-maximization algorithm with underlying Markov random fields improved this initial classifier over successive iterations to better approximate the boundary of the inclusion. Results demonstrate robustness with respect to inclusion shape, size, and the initial classifier value. For three trials segmenting a cubic inclusion, sensitivity was above 0.95 and specificity was above 0.92.

[1]  J. Ophir,et al.  Elastography: A Quantitative Method for Imaging the Elasticity of Biological Tissues , 1991, Ultrasonic imaging.

[2]  P. Grigsby,et al.  Effect of tumor size on the prognosis of carcinoma of the uterine cervix treated with irradiation alone , 1992, Cancer.

[3]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[4]  Vijay K. Jain,et al.  Markov random field for tumor detection in digital mammography , 1995, IEEE Trans. Medical Imaging.

[5]  Robert D. Howe,et al.  Remote Palpation Technology for Surgical Applications , 1995 .

[6]  B. Garra,et al.  Elastography of breast lesions: initial clinical results. , 1997, Radiology.

[7]  R. Bergamaschi.  Laparoscopic surgery for cure of colorectal cancer , 1997, Surgical Endoscopy.

[8]  T. Krouskop,et al.  Elastographic characterization of HIFU-induced lesions in canine livers. , 1999, Ultrasound in medicine & biology.

[9]  Guido Gerig,et al.  Automatic brain tumor segmentation by subject specific modification of atlas priors. , 2003, Academic radiology.

[10]  Joseph A. Smith,et al.  Laparoscopic radical prostatectomy: oncological evaluation after 1,000 cases at Montsouris Institute , 2003 .

[11]  R. Tozzi,et al.  Laparoscopic treatment of early ovarian cancer: surgical and survival outcomes. , 2004, Gynecologic oncology.

[12]  L. Curiel,et al.  Elastography for the follow-up of high-intensity focused ultrasound prostate cancer treatment: initial comparison with MRI. , 2005, Ultrasound in medicine & biology.

[13]  M. Koch,et al.  Laparoscopic surgery for colorectal cancer , 2006, Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland.

[14]  Shoji Hara,et al.  A Machine Learning Approach for Locating Boundaries of Liver Tumors in CT Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Armen P. Sarvazyan,et al.  Mechanical Imaging of the Breast , 2008, IEEE Transactions on Medical Imaging.

[16]  D. Rubens,et al.  Tissue elasticity properties as biomarkers for prostate cancer. , 2008, Cancer biomarkers : section A of Disease markers.

[17]  R. Ehman,et al.  MR elastography of liver tumors: preliminary results. , 2008, AJR. American journal of roentgenology.

[18]  Stephen T. C. Wong,et al.  Automated brain tumor segmentation using spatial accuracy-weighted hidden Markov Random Field , 2009, Comput. Medical Imaging Graph..

[19]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  A. Sarvazyan,et al.  Differentiation of benign and malignant breast lesions by mechanical imaging , 2009, Breast Cancer Research and Treatment.

[21]  Rajnikant V. Patel,et al.  Robot-assisted Tactile Sensing for Minimally Invasive Tumor Localization , 2009, Int. J. Robotics Res..

[22]  Christos Davatzikos,et al.  Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme , 2009, Magnetic resonance in medicine.

[23]  Mitchell D. Schnall,et al.  Segmentation and classification of triple negative breast cancers using DCE-MRI , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  Stan Z. Li.  Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.

[25]  Xin Liu,et al.  Prostate Cancer Segmentation With Simultaneous Estimation of Markov Random Field Parameters and Class , 2009, IEEE Transactions on Medical Imaging.

[26]  A. D'Amico,et al.  Radical retropubic prostatectomy and robotic-assisted laparoscopic prostatectomy: likelihood of positive surgical margin(s). , 2010, Urology.

[27]  K. Brock.  Results of a multi-institution deformable registration accuracy study (MIDRAS). , 2010, International journal of radiation oncology, biology, physics.

[28]  Kaspar Althoefer,et al.  Rolling Mechanical Imaging for Tissue Abnormality Localization During Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.

[29]  P. Walsh.  Radical retropubic prostatectomy and robotic-assisted laparoscopic prostatectomy: Likelihood of positive surgical margin(s) , 2010 .

[30]  Kaspar Althoefer,et al.  Finite-Element Modeling of Soft Tissue Rolling Indentation , 2011, IEEE Transactions on Biomedical Engineering.

[31]  Yen-Wei Chen,et al.  Liver tumor detection in CT images by adaptive contrast enhancement and the EM/MPM algorithm , 2011, 2011 18th IEEE International Conference on Image Processing.

[32]  Nabil Simaan,et al.  Algorithms for autonomous exploration and estimation in compliant environments , 2012, Robotica.

[33]  W. Marsden.  I and J , 2012 .

[34]  Jung Kim,et al.  Robotic palpation and mechanical property characterization for abnormal tissue localization , 2012, Medical & Biological Engineering & Computing.

[35]  Michael C. Yip,et al.  Registration of 3D Ultrasound Through an Air–Tissue Boundary , 2012, IEEE Transactions on Medical Imaging.

[36]  Allison M. Okamura,et al.  Autonomous robotic palpation: Machine learning techniques to identify hard inclusions in soft tissues , 2013, 2013 IEEE International Conference on Robotics and Automation.

[37]  Pietro Valdastri,et al.  Wireless Tissue Palpation for Intraoperative Detection of Lumps in the Soft Tissue , 2014, IEEE Transactions on Biomedical Engineering.