Robust algorithms for property recovery in motion modeling, medical imaging and biometrics

The past two decades has witnessed growing interest in physics based techniques in computer vision, computer graphics and medical imaging. The main advantage of a physical model is its mathematical rigor and physical soundness, which makes it an ideal tool to study complex nonrigid motion. However, since a model based on continuum mechanics is computationally demanding, an idealized framework is often adopted where physical motion parameters are significantly simplified, which inevitably affects the accuracy and reliability of modeling results. In this study, a new modeling approach is developed that features the reconstruction of actual material properties such as the Young's modulus and the Poisson's ratio. Justified by the constitutive law and mathematical considerations, the Young's modulus is identified as a unique physical motion parameter. By imposing an adaptive smoothness constraint, the Young's modulus helps preserve the local characteristics (discontinuity) of an object's deformation, a role similar to the weighting coefficient in the study of edge-preserving visual surface reconstruction. The contribution of this work is fourfold: (1) two recovery algorithms are developed to solve the inverse elastic problem: A deterministic algorithm that is based on the Gauss-Newton method and the general cross validation, and a stochastic algorithm that is based on the constrained genetic evolution; (2) a new modeling approach is proposed that has the ability to recover nonrigid motion in terms of the physical parameters. The use of recovered parameters can be implemented within a boundary-driven motion synthesis scheme; (3) A sensitivity method is proposed to evaluate the impact of different parameters. The method uses the adjoint state equation and hence is suitable for large scale models. (4) The proposed modeling approach has been applied to burn scar assessment and face recognition.

[1]  Genki Yagawa,et al.  INELASTIC CONSTITUTIVE PARAMETER IDENTIFICATION USING AN EVOLUTIONARY ALGORITHM WITH CONTINUOUS INDIVIDUALS , 1997 .

[2]  Martin O. Leach,et al.  A method for the comparison of biomechanical breast models , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[3]  Jake K. Aggarwal,et al.  Articulated and elastic non-rigid motion: a review , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[4]  W. Larrabee,et al.  A finite element model of skin deformation. III. The finite element model , 1986, The Laryngoscope.

[5]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[6]  J. Bamber,et al.  Quantitative elasticity imaging: what can and cannot be inferred from strain images. , 2002, Physics in medicine and biology.

[7]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[8]  Xin Yao,et al.  Constrained Evolutionary Optimization , 2003 .

[9]  Thomas S. Huang,et al.  Modeling, analysis, and visualization of nonrigid object motion , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[10]  K. R. Raghavan,et al.  Forward and inverse problems in elasticity imaging of soft tissues , 1994 .

[11]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[12]  S. Timoshenko,et al.  Theory of Elasticity (3rd ed.) , 1970 .

[13]  E. Yeong,et al.  Improved burn scar assessment with use of a new scar-rating scale. , 1997, The Journal of burn care & rehabilitation.

[14]  Y. Fung Foundations of solid mechanics , 1965 .

[15]  P. Stark Inverse problems as statistics , 2002 .

[16]  A. Manduca,et al.  Magnetic resonance elastography by direct visualization of propagating acoustic strain waves. , 1995, Science.

[17]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[18]  James Ralston,et al.  On the inverse boundary value problem for linear isotropic elasticity , 2002 .

[19]  E. Frei,et al.  Breast cancer screening by impedance measurements. , 1990, Frontiers of medical and biological engineering : the international journal of the Japan Society of Medical Electronics and Biological Engineering.

[20]  Dmitry B. Goldgof,et al.  A vision-based technique for objective assessment of burn scars , 1998, IEEE Transactions on Medical Imaging.

[21]  Armando Manduca,et al.  Imaging elastic properties of biological tissues by low-frequency harmonic vibration , 2003, Proc. IEEE.

[22]  Markus Gross,et al.  Simulating facial surgery using finite element models , 1996 .

[23]  Dmitry B. Goldgof,et al.  Towards Physically-Sound Registration Using Object-Specific Properties for Regularization , 2003, WBIR.

[24]  A. Tarantola Inverse problem theory : methods for data fitting and model parameter estimation , 1987 .

[25]  G. Golub,et al.  Generalized cross-validation for large scale problems , 1997 .

[26]  Larry S. Davis,et al.  Smiling faces are better for face recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[27]  Sudeep Sarkar,et al.  Scar assessment: current problems and future solutions. , 1999, The Journal of burn care & rehabilitation.

[28]  Christos Davatzikos,et al.  Nonlinear elastic registration of brain images with tumor pathology using a biomechanical model [MRI] , 1999, IEEE Transactions on Medical Imaging.

[29]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[30]  C Hal Chaplin,et al.  Anatomy of the Head, Neck, Face, and Jaws , 1981 .

[31]  H. W. Engl Identification Of Parameters In Polymer Crystallization, Semiconductor Models And Elasticity Via Iterative Regularization Methods H. W. Engl , 2002 .

[32]  Christian Laugier,et al.  Constrain-based identification of a dynamic model , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[33]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[34]  K D Paulsen,et al.  An overlapping subzone technique for MR‐based elastic property reconstruction , 1999, Magnetic resonance in medicine.

[35]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[36]  A. Sedat Çöloǧlu,et al.  Forensic analysis of the skull: Craniofacial analysis, reconstruction, and identification , 1995 .

[37]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[38]  Ralf Salomon,et al.  Evolutionary algorithms and gradient search: similarities and differences , 1998, IEEE Trans. Evol. Comput..

[39]  A.R. Skovoroda,et al.  Prospects for elasticity reconstruction in the heart , 2004, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[40]  V. Morozov On the solution of functional equations by the method of regularization , 1966 .

[41]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Zenon Mróz,et al.  VARIATIONAL APPROACH TO SENSITIVITY ANALYSIS IN THERMOELASTICITY , 1987 .

[44]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[45]  Muneo Hori,et al.  Inverse Analysis Method for Identification of Local Elastic Properties by Using Displacement Data , 2003 .

[46]  Dmitry B. Goldgof,et al.  Recovery of global nonrigid motion-a model based approach without point correspondences , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Mubarak Shah,et al.  Motion-Based Recognition , 1997, Computational Imaging and Vision.

[48]  Cynthia Bruyns,et al.  Measurements of Soft-Tissue Mechanical Properties to Support Development of a Physically Based Virtual Animal Model , 2002, MICCAI.

[49]  E. Reissner A note on variational principles in elasticity , 1965 .

[50]  M. Doyley,et al.  Evaluation of an iterative reconstruction method for quantitative elastography , 2000 .

[51]  Alain Blouin,et al.  All-optical measurement of in-plane and out-of-plane Young's modulus and Poisson's ratio in silicon wafers by means of vibration modes , 2004 .

[52]  K. Paulsen,et al.  A computational model for tracking subsurface tissue deformation during stereotactic neurosurgery , 1999, IEEE Transactions on Biomedical Engineering.

[53]  Faouzi Kallel,et al.  Tissue elasticity reconstruction using linear perturbation method , 1996, IEEE Trans. Medical Imaging.

[54]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[55]  Edward J. Haug,et al.  Design Sensitivity Analysis of Structural Systems , 1986 .

[56]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[57]  Kevin J. Parker,et al.  Techniques for elastic imaging: a review , 1996 .

[58]  Pier Paolo Delsanto,et al.  A Genetic Algorithm for the determination of the elastic constants of a monoclinic crystal , 2000 .

[59]  Lawrence E. Payne,et al.  Uniqueness Theorems in Linear Elasticity , 1971 .

[60]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Edward J. Garboczi,et al.  An algorithm for computing the effective linear elastic properties of heterogeneous materials: Three-dimensional results for composites with equal phase poisson ratios , 1995 .

[62]  J. Z. Zhu,et al.  The finite element method , 1977 .

[63]  C. Truesdell,et al.  The Non-Linear Field Theories Of Mechanics , 1992 .

[64]  R L Ehman,et al.  Complex‐valued stiffness reconstruction for magnetic resonance elastography by algebraic inversion of the differential equation , 2001, Magnetic resonance in medicine.

[65]  B. Simon,et al.  Arterial mechanics in spontaneously hypertensive rats. Mechanical properties, hydraulic conductivity, and two-phase (solid/fluid) finite element models. , 1992, Circulation research.

[66]  E. Haber,et al.  A GCV based method for nonlinear ill-posed problems , 2000 .

[67]  Jonathan Ophir,et al.  Elastography: Imaging the elastic properties of soft tissues with ultrasound , 2002, Journal of Medical Ultrasonics.

[68]  Lin Ji,et al.  Recovery of the Lam´ ep arameter µ in biological tissues , 2004 .

[69]  Nail Gumerov,et al.  Application of a Hybrid Genetic/PowellAlgorithm and a Boundary Element Methodto Electrical Impedance Tomography , 2001 .

[70]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[71]  Jake K. Aggarwal,et al.  Nonrigid Motion Analysis: Articulated and Elastic Motion , 1998, Comput. Vis. Image Underst..

[72]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[73]  Jun Liu A Multiresolution Method for Distributed Parameter Estimation , 1993, SIAM J. Sci. Comput..

[74]  Arnold Neumaier,et al.  Introduction to Numerical Analysis , 2001 .

[75]  M. Burger,et al.  Level set methods for geometric inverse problems in linear elasticity , 2004 .

[76]  K. Rohr,et al.  Biomechanical modeling of the human head for physically based, nonrigid image registration , 1999, IEEE Transactions on Medical Imaging.

[77]  Kenneth Y. Goldberg,et al.  Needle insertion and radioactive seed implantation in human tissues: simulation and sensitivity analysis , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[78]  A.R. Skovoroda,et al.  Measuring the nonlinear elastic properties of tissue-like phantoms , 2004, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[79]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[80]  J. Bishop,et al.  Visualization and quantification of breast cancer biomechanical properties with magnetic resonance elastography. , 2000, Physics in medicine and biology.

[81]  Dmitry B. Goldgof,et al.  Model-based nonrigid motion analysis using natural feature adaptive mesh , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[82]  Jingfeng Jiang,et al.  A finite-element approach for Young's modulus reconstruction , 2003, IEEE Transactions on Medical Imaging.

[83]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[84]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[85]  O. SCHERZER,et al.  On the Landweber iteration for nonlinear ill-posed problems , 1996 .

[86]  J. Saffle,et al.  Recent outcomes in the treatment of burn injury in the United States: a report from the American Burn Association Patient Registry. , 1995, The Journal of burn care & rehabilitation.

[87]  Ron Kikinis,et al.  Registration of 3-d intraoperative MR images of the brain using a finite-element biomechanical model , 2000, IEEE Transactions on Medical Imaging.

[88]  G. Uhlmann,et al.  IDENTIFICATION OF LAME PARAMETERS BY BOUNDARY MEASUREMENTS , 1993 .

[89]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[90]  C. G. Shaefer,et al.  The ARGOT Strategy: Adaptive Representation Genetic Optimizer Technique , 1987, ICGA.

[91]  Gunther Uhlmann,et al.  Developments in inverse problems since Calderon’s foundational paper , 1999 .

[92]  J. Ophir,et al.  Elastography: A Quantitative Method for Imaging the Elasticity of Biological Tissues , 1991, Ultrasonic imaging.

[93]  Michel Bertrand,et al.  Noninvasive vascular elastography: theoretical framework , 2004, IEEE Transactions on Medical Imaging.

[94]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[95]  Dimitris N. Metaxas,et al.  Constrained deformable superquadrics and nonrigid motion tracking , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[96]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[97]  Demetri Terzopoulos Regularization ofInverseVisualProblemsInvolving Discontinuities , 1986 .

[98]  Piotr Orantek Hybrid Evolutionary Algorithms in Optimization of Structures under Dynamical Loads , 2004 .

[99]  Nicholas Ayache,et al.  Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[100]  Christoph H. Arns,et al.  Computation of Linear Elastic Properties from Microtomographic Images: Methodology and Match to Theory and Experiment. , 2002 .

[101]  F. Duck Physical properties of tissue , 1990 .

[102]  Cheng-Hung Huang,et al.  A non‐linear inverse vibration problem of estimating the time‐dependent stiffness coefficients by conjugate gradient method , 2001 .

[103]  A. Tikhonov,et al.  Numerical Methods for the Solution of Ill-Posed Problems , 1995 .

[104]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[105]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[106]  Jonathan Bishop,et al.  A constrained modulus reconstruction technique for breast cancer assessment , 2001, IEEE Transactions on Medical Imaging.

[107]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[108]  Dmitry B. Goldgof,et al.  Nonrigid motion analysis based on dynamic refinement of finite element models , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[109]  Assad A. Oberai,et al.  INVERSE PROBLEMS PII: S0266-5611(03)54272-1 Solution of inverse problems in elasticity imaging using the adjoint method , 2003 .

[110]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[111]  Dmitry B. Goldgof,et al.  Elastic face - an anatomy-based biometrics beyond visible cue , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[112]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[113]  S. Timoshenko,et al.  Theory of elasticity , 1975 .

[114]  Michael I Miga A new approach to elastography using mutual information and finite elements. , 2003, Physics in medicine and biology.

[115]  S. Priori,et al.  A genetic algorithm approach to image reconstruction in electrical impedance tomography , 2000, IEEE Trans. Evol. Comput..

[116]  M. O'Donnell,et al.  Model-based reconstructive elasticity imaging of deep venous thrombosis , 2004, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[117]  Antoni John,et al.  Material Coefficients Identification of Bone Tissues Using Evolutionary Algorithms , 2003 .

[118]  M. O’Donnell,et al.  Theoretical analysis and verification of ultrasound displacement and strain imaging , 1994, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[119]  Frédérique Frouin,et al.  Ultrasound elastography based on multiscale estimations of regularized displacement fields , 2004, IEEE Transactions on Medical Imaging.

[120]  Graham F. Carey,et al.  Computational grids : generation, adaptation, and solution strategies , 1997 .

[121]  K. Miller Least Squares Methods for Ill-Posed Problems with a Prescribed Bound , 1970 .

[122]  Dimitris N. Metaxas Physics-Based Deformable Models: Applications to Computer Vision, Graphics, and Medical Imaging , 1996 .

[123]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[124]  E. Haber,et al.  Grid refinement and scaling for distributed parameter estimation problems , 2001 .

[125]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[126]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[127]  Dmitry B. Goldgof,et al.  Nonrigid motion analysis , 1994 .

[128]  Dimitris N. Metaxas,et al.  Methods for Modeling and Predicting Mechanical Deformations of the Breast Under External Perturbations , 2001, MICCAI.

[129]  Chikayoshi Sumi,et al.  A robust numerical solution to reconstruct a globally relative shear modulus distribution from strain measurements , 1998, IEEE Transactions on Medical Imaging.

[130]  L. D. Chiwiacowsky,et al.  A variational approach for solving an inverse vibration problem , 2006 .

[131]  D. Shulman,et al.  (Non-)rigid motion interpretation : a regularized approach , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[132]  Zbigniew Michalewicz,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[133]  J Smith,et al.  Rating the burn scar. , 1990, The Journal of burn care & rehabilitation.

[134]  Kevin J. Parker,et al.  Feature-adaptive motion tracking of ultrasound image sequences using a deformable mesh , 1998, IEEE Transactions on Medical Imaging.