Simulation-Based Joint Estimation of Body Deformation and Elasticity Parameters for Medical Image Analysis

Estimation of tissue stiffness is an important means of noninvasive cancer detection. Existing elasticity reconstruction methods usually depend on a dense displacement field (inferred from ultrasound or MR images) and known external forces. Many imaging modalities, however, cannot provide details within an organ and therefore cannot provide such a displacement field. Furthermore, force exertion and measurement can be difficult for some internal organs, making boundary forces another missing parameter. We propose a general method for estimating elasticity and boundary forces automatically using an iterative optimization framework, given the desired (target) output surface. During the optimization, the input model is deformed by the simulator, and an objective function based on the distance between the deformed surface and the target surface is minimized numerically. The optimization framework does not depend on a particular simulation method and is therefore suitable for different physical models. We show a positive correlation between clinical prostate cancer stage (a clinical measure of severity) and the recovered elasticity of the organ. Since the surface correspondence is established, our method also provides a nonrigid image registration, where the quality of the deformation fields is guaranteed, as they are computed using a physics-based simulation.

[1]  William Gropp,et al.  Efficient Management of Parallelism in Object-Oriented Numerical Software Libraries , 1997, SciTools.

[2]  Weiant Wathen-Dunn,et al.  Models for the perception of speech and visual form : proceedings of a symposium , 1967 .

[3]  P. Tallec,et al.  Joint state and parameter estimation for distributed mechanical systems , 2008 .

[4]  J. F. Greenleaf,et al.  Magnetic resonance elastography: Non-invasive mapping of tissue elasticity , 2001, Medical Image Anal..

[5]  Jingfeng Jiang,et al.  A finite-element approach for Young's modulus reconstruction , 2003, IEEE Transactions on Medical Imaging.

[6]  Z. Popovic,et al.  Fluid control using the adjoint method , 2004, SIGGRAPH 2004.

[7]  Xiaogang Jin,et al.  Shape deformation with tunable stiffness , 2008, The Visual Computer.

[8]  David Beyer,et al.  Prediction of intrafraction prostate motion: accuracy of pre- and post-treatment imaging and intermittent imaging. , 2009, International journal of radiation oncology, biology, physics.

[9]  Karol Miller,et al.  Patient-specific model of brain deformation: application to medical image registration. , 2007, Journal of biomechanics.

[10]  R. Ehman,et al.  Magnetic resonance elastography , 1996, Nature Medicine.

[11]  Eitan Grinspun,et al.  TRACKS: toward directable thin shells , 2007, ACM Trans. Graph..

[12]  Long Chen FINITE ELEMENT METHOD , 2013 .

[13]  Jürgen Weese,et al.  Landmark-based elastic registration using approximating thin-plate splines , 2001, IEEE Transactions on Medical Imaging.

[14]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[15]  S Girod,et al.  Three-dimensional simulation and prediction of craniofacial surgery. , 2003, Orthodontics & craniofacial research.

[16]  K J Parker,et al.  Non-invasive quantitative reconstruction of tissue elasticity using an iterative forward approach. , 2000, Physics in medicine and biology.

[17]  Edward L. Chaney,et al.  Image Estimation from Marker Locations for Dose Calculation in Prostate Radiation Therapy , 2010, MICCAI.

[18]  Paul A. Yushkevich,et al.  Deformable M-Reps for 3D Medical Image Segmentation , 2003, International Journal of Computer Vision.

[19]  Faouzi Kallel,et al.  Tissue elasticity reconstruction using linear perturbation method , 1996, IEEE Trans. Medical Imaging.

[20]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[21]  John Wong,et al.  Accuracy of a wireless localization system for radiotherapy. , 2005, International journal of radiation oncology, biology, physics.

[22]  Jos Stam,et al.  Stable fluids , 1999, SIGGRAPH.

[23]  Ronald Fedkiw,et al.  Visual simulation of smoke , 2001, SIGGRAPH.

[24]  It Informatics,et al.  Portable, Extensible Toolkit for Scientific Computation , 2012 .

[25]  A.D. Hughes,et al.  Improvement of a retinal blood vessel segmentation method using the Insight Segmentation and Registration Toolkit (ITK) , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Markus H. Gross,et al.  A Finite Element Method on Convex Polyhedra , 2007, Comput. Graph. Forum.

[27]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[28]  R. Bajcsy,et al.  A computerized system for the elastic matching of deformed radiographic images to idealized atlas images. , 1983, Journal of computer assisted tomography.

[29]  D Yan,et al.  An off-line strategy for constructing a patient-specific planning target volume in adaptive treatment process for prostate cancer. , 2000, International journal of radiation oncology, biology, physics.

[30]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[31]  C. Huntzinger Image Guided Radiation Therapy , 2005 .

[32]  Gábor Székely,et al.  Inverse Finite Element Characterization of Soft Tissues , 2001, MICCAI.

[33]  T. Krouskop,et al.  Elastography: Ultrasonic estimation and imaging of the elastic properties of tissues , 1999, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[34]  Robert L. Galloway,et al.  Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements , 2005, IEEE Transactions on Medical Imaging.

[35]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[36]  Matthias Teschner,et al.  Robust and Efficient Estimation of Elasticity Parameters using the linear Finite Element Method , 2007, SimVis.

[37]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[38]  Stephen M. Pizer,et al.  Rotational flows for interpolation between sampled surfaces , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[39]  Ming C. Lin,et al.  Fast optimization-based elasticity parameter estimation using reduced models , 2012, The Visual Computer.

[40]  Robert Rohling,et al.  Real-time solution of the finite element inverse problem of viscoelasticity , 2011 .

[41]  M. Otaduy,et al.  Design and fabrication of materials with desired deformation behavior , 2010, ACM Trans. Graph..

[42]  R. Mohan,et al.  Optimization of intensity-modulated radiotherapy plans based on the equivalent uniform dose. , 2002, International journal of radiation oncology, biology, physics.

[43]  Stuart Crozier,et al.  Real-Time Surgical Simulation Using Reduced Order Finite Element Analysis , 2010, MICCAI.

[44]  Vladimir Pekar,et al.  Assessment of a model-based deformable image registration approach for radiation therapy planning. , 2007, International journal of radiation oncology, biology, physics.

[45]  L. Sobin,et al.  TNM Classification of Malignant Tumours , 1987, UICC International Union Against Cancer.

[46]  A. D'Amico,et al.  Evaluation of three-dimensional finite element-based deformable registration of pre- and intraoperative prostate imaging. , 2001, Medical physics.

[47]  Edward L. Chaney,et al.  Automated Finite-Element Analysis for Deformable Registration of Prostate Images , 2007, IEEE Transactions on Medical Imaging.

[48]  Ron Kikinis,et al.  3D Image Matching Using a Finite Element Based Elastic Deformation Model , 1999, MICCAI.

[49]  Sarang Joshi,et al.  Large deformation three-dimensional image registration in image-guided radiation therapy , 2005, Physics in medicine and biology.

[50]  Gábor Székely,et al.  Hybrid Cutting of Deformable Solids , 2006, IEEE Virtual Reality Conference (VR 2006).

[51]  Armen P. Sarvazyan,et al.  Prostate mechanical imaging: 3-D image composition and feature calculations , 2006, IEEE Transactions on Medical Imaging.

[52]  D. Yan,et al.  Reducing uncertainties in volumetric image based deformable organ registration. , 2003, Medical physics.

[53]  K. Nightingale,et al.  Acoustic radiation force impulse imaging of human prostates: initial in vivo demonstration. , 2012, Ultrasound in medicine & biology.

[54]  Kun Zhou,et al.  2D shape deformation using nonlinear least squares optimization , 2006, The Visual Computer.

[55]  Adrien Treuille,et al.  Keyframe control of smoke simulations , 2003, ACM Trans. Graph..

[56]  J. Hornaday,et al.  Cancer Facts & Figures 2004 , 2004 .

[57]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[58]  Jovan Popović,et al.  Deformable object animation using reduced optimal control , 2009, SIGGRAPH 2009.

[59]  Michael J Ackerman,et al.  Engineering and algorithm design for an image processing Api: a technical report on ITK--the Insight Toolkit. , 2002, Studies in health technology and informatics.

[60]  Alejandro F. Frangi,et al.  Towards Regional Elastography of Intracranial Aneurysms , 2008, MICCAI.

[61]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, SIGGRAPH '05.

[62]  Li Yuan-yuan A SURVEY OF MEDICAL IMAGE REGISTRATION , 2006 .

[63]  Mark Holden,et al.  A Review of Geometric Transformations for Nonrigid Body Registration , 2008, IEEE Transactions on Medical Imaging.

[64]  D. Schnur,et al.  An inverse method for determining elastic material properties and a material interface , 1992 .

[65]  J. Marsden,et al.  Dimensional model reduction in non‐linear finite element dynamics of solids and structures , 2001 .

[66]  Wojciech Matusik,et al.  Design and fabrication of materials with desired deformation behavior , 2010, SIGGRAPH 2010.

[67]  Marie-Paule Cani,et al.  A layered model of a virtual human intestine for surgery simulation , 2005, Medical Image Anal..

[68]  T. Krouskop,et al.  Elastic Moduli of Breast and Prostate Tissues under Compression , 1998, Ultrasonic imaging.

[69]  E. Messing,et al.  Quantitative characterization of viscoelastic properties of human prostate correlated with histology. , 2008, Ultrasound in medicine & biology.

[70]  J. Schnabel,et al.  Factors influencing the accuracy of biomechanical breast models. , 2006, Medical physics.

[71]  Timothy F. Cootes,et al.  Active shape models , 1998 .

[72]  Maxime Sermesant,et al.  Cardiac Function Estimation from MRI Using a Heart Model and Data Assimilation: Advances and Difficulties , 2005, FIMH.

[73]  Gregg Tracton,et al.  Training models of anatomic shape variability. , 2008, Medical physics.

[74]  Gregg Tracton,et al.  SU‐FF‐T‐362: PLanUNC as An Open‐Source Radiotherapy Planning System for Research and Education , 2006 .

[75]  Ron Kikinis,et al.  Registration of 3-d intraoperative MR images of the brain using a finite-element biomechanical model , 2000, IEEE Transactions on Medical Imaging.

[76]  Andrew H. Gee,et al.  3D elastography using freehand ultrasound. , 2006 .

[77]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[78]  Abbas Samani,et al.  Detecting Mechanical Abnormalities in Prostate Tissue Using FE-Based Image Registration , 2007, MICCAI.

[79]  David J. Thuente,et al.  Line search algorithms with guaranteed sufficient decrease , 1994, TOMS.

[80]  Samuel Boivin,et al.  Estimation of mechanical parameters of deformable solids from videos , 2008, The Visual Computer.

[81]  Indrin J Chetty,et al.  Synchronized dynamic dose reconstruction. , 2006, Medical physics.

[82]  Septimiu E. Salcudean,et al.  Viscoelasticity Modeling of the Prostate Region Using Vibro-elastography , 2006, MICCAI.

[83]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[84]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[85]  Gregory D. Hager,et al.  Ultrasound Elastography: A Dynamic Programming Approach , 2008, IEEE Transactions on Medical Imaging.

[86]  Ronald Fedkiw,et al.  Practical animation of liquids , 2001, SIGGRAPH.

[87]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[88]  Eigil Samset,et al.  Bayesian Estimation of Deformation and Elastic Parameters in Non-rigid Registration , 2010, WBIR.

[89]  Dinesh K. Pai,et al.  Scanning physical interaction behavior of 3D objects , 2001, SIGGRAPH.

[90]  Masoom A Haider,et al.  Development of multiorgan finite element-based prostate deformation model enabling registration of endorectal coil magnetic resonance imaging for radiotherapy planning. , 2007, International journal of radiation oncology, biology, physics.

[91]  Cagatay Basdogan,et al.  Characterization of frequency-dependent material properties of human liver and its pathologies using an impact hammer , 2011, Medical Image Anal..

[92]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[93]  James F. O'Brien,et al.  Interactive simulation of surgical needle insertion and steering , 2009, SIGGRAPH 2009.

[94]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[95]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[96]  Michael I. Miga,et al.  Modality independent elastography (MIE): a new approach to elasticity imaging , 2004, IEEE Transactions on Medical Imaging.

[97]  Lisa Grimm,et al.  Image-guided radiotherapy for prostate cancer by CT-linear accelerator combination: prostate movements and dosimetric considerations. , 2005, International journal of radiation oncology, biology, physics.

[98]  A.R. Skovoroda,et al.  Tissue elasticity reconstruction based on ultrasonic displacement and strain images , 1995, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[99]  R. W. Prager,et al.  ELASTOGRAPHY USING FREEHAND ULTRASOUND , 2005 .

[100]  Ron Kikinis,et al.  Registration of 3D Intraoperative MR Images of the Brain Using a Finite Element Biomechanical Model , 2001, IEEE Trans. Medical Imaging.

[101]  Ken Goldberg,et al.  Registration of MR prostate images with biomechanical modeling and nonlinear parameter estimation. , 2006, Medical physics.

[102]  Patrick A Kupelian,et al.  Observations on real-time prostate gland motion using electromagnetic tracking. , 2008, International journal of radiation oncology, biology, physics.

[103]  J. Z. Zhu,et al.  The finite element method , 1977 .

[104]  Rajiv Chopra,et al.  In vivo MR elastography of the prostate gland using a transurethral actuator , 2009, Magnetic resonance in medicine.

[105]  William H. Press,et al.  Numerical recipes , 1990 .

[106]  Hang Si,et al.  TetGen: A quality tetrahedral mesh generator and a 3D Delaunay triangulator (Version 1.5 --- User's Manual) , 2013 .

[107]  Wojciech Matusik,et al.  Capture and modeling of non-linear heterogeneous soft tissue , 2009, ACM Trans. Graph..

[108]  Dinesh Manocha,et al.  Collision Handling in Dynamic Simulation Environments , 2005, Eurographics.

[109]  Andrew Thall,et al.  A method and software for segmentation of anatomic object ensembles by deformable m-reps. , 2005, Medical physics.

[110]  Ronald Fedkiw,et al.  Animation and rendering of complex water surfaces , 2002, ACM Trans. Graph..

[111]  Ming C. Lin,et al.  Physically-based deformable image registration with material property and boundary condition estimation , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[112]  Lianghao Han,et al.  Development of patient-specific biomechanical models for predicting large breast deformation , 2012, Physics in medicine and biology.