Scan-Based Volume Animation Driven by Locally Adaptive Articulated Registrations

This paper describes a complete system to create anatomically accurate example-based volume deformation and animation of articulated body regions, starting from multiple in vivo volume scans of a specific individual. In order to solve the correspondence problem across volume scans, a template volume is registered to each sample. The wide range of pose variations is first approximated by volume blend deformation (VBD), providing proper initialization of the articulated subject in different poses. A novel registration method is presented to efficiently reduce the computation cost while avoiding strong local minima inherent in complex articulated body volume registration. The algorithm highly constrains the degrees of freedom and search space involved in the nonlinear optimization, using hierarchical volume structures and locally constrained deformation based on the biharmonic clamped spline. Our registration step establishes a correspondence across scans, allowing a data-driven deformation approach in the volume domain. The results provide an occlusion-free person-specific 3D human body model, asymptotically accurate inner tissue deformations, and realistic volume animation of articulated movements driven by standard joint control estimated from the actual skeleton. Our approach also addresses the practical issues arising in using scans from living subjects. The robustness of our algorithms is tested by their applications on the hand, probably the most complex articulated region in the body, and the knee, a frequent subject area for medical imaging due to injuries.

[1]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[2]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[3]  Min Chen,et al.  Manipulating, Deforming and Animating Sampled Object Representations , 2007, Comput. Graph. Forum.

[4]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[5]  A. Ardeshir Goshtasby,et al.  A comparative study of transformation functions for nonrigid image registration , 2006, IEEE Transactions on Image Processing.

[6]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[7]  Rüdiger Westermann,et al.  Real‐Time Volume Deformations , 2001, Comput. Graph. Forum.

[8]  James E. Gain,et al.  Animation space: A truly linear framework for character animation , 2006, TOGS.

[9]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[10]  Makiko Kouchi,et al.  Finger joint kinematics from MR images , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Xia Li,et al.  Automatic registration of whole body serial micro CT images with a combination of point-based and intensity-based registration techniques , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[12]  Holger Wendland,et al.  Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree , 1995, Adv. Comput. Math..

[13]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[14]  Tsuneya Kurihara,et al.  Modeling deformable human hands from medical images , 2004, SCA '04.

[15]  Stephen R. Marsland,et al.  Constructing diffeomorphic representations for the groupwise analysis of nonrigid registrations of medical images , 2004, IEEE Transactions on Medical Imaging.

[16]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[17]  Jun Ota,et al.  Identification of position and orientation of hand bones from MR images by bone model registration , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[19]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[20]  Brian B. Avants,et al.  Non-Rigid Image Registration , 2004 .

[21]  Francisco J. Valero Cuevas,et al.  Estimating Effective Degrees of Freedom in Motor Systems , 2008, IEEE Transactions on Biomedical Engineering.

[22]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[23]  Roni Yagel,et al.  Space Deformation using Ray Deflectors , 1995, Rendering Techniques.

[24]  Michael John Ackerman,et al.  The Visible Human Project. , 1991 .

[25]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[26]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[27]  Jirí Zára,et al.  Spherical blend skinning: a real-time deformation of articulated models , 2005, I3D '05.

[28]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[29]  John P. Lewis,et al.  Soft-Tissue Deformation for In Vivo Volume Animation , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[30]  Lawrence H. Staib,et al.  Articulated Rigid Registration for Serial Lower-Limb Mouse Imaging , 2005, MICCAI.

[31]  Günther Greiner,et al.  Fast volumetric deformation on general purpose hardware , 2001, HWWS '01.

[32]  Nadia Magnenat-Thalmann,et al.  Synthesizing animatable body models with parameterized shape modifications , 2003, SCA '03.

[33]  Harry Shum,et al.  Motion estimation with quadtree splines , 1995, Proceedings of IEEE International Conference on Computer Vision.

[34]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[35]  A. du Bois d'Aische,et al.  An Improved Articulated Registration Method For Neck Images , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[36]  Benoit M. Dawant,et al.  The adaptive bases algorithm for intensity-based nonrigid image registration , 2003, IEEE Transactions on Medical Imaging.

[37]  D. Hill,et al.  Non-rigid image registration: theory and practice. , 2004, The British journal of radiology.

[38]  G. Elisabeta Marai,et al.  Super-resolution registration using tissue-classified distance fields , 2006, IEEE Transactions on Medical Imaging.

[39]  Gershon Elber,et al.  Papercraft Models using Generalized Cylinders , 2007 .

[40]  Deborah Silver,et al.  Animating Volumetric Models , 2001, Graph. Model..

[41]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[42]  Vikas Singh,et al.  Interactive volume manipulation with selective rendering for improved visualization , 2004, 2004 IEEE Symposium on Volume Visualization and Graphics.

[43]  M J Ackerman,et al.  The Visible Human Project , 1998, Proc. IEEE.

[44]  Ronald Fedkiw,et al.  Creating and simulating skeletal muscle from the visible human data set , 2005, IEEE Transactions on Visualization and Computer Graphics.

[45]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[46]  Hyunjin Park,et al.  Adaptive registration using local information measures , 2004, Medical Image Anal..

[47]  John P. Lewis,et al.  Adaptive non-rigid registration of 3D knee MRI in different pose spaces , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[48]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[49]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[50]  John P. Lewis,et al.  Real‐Time Weighted Pose‐Space Deformation on the GPU , 2006, Comput. Graph. Forum.

[51]  Mark Holden,et al.  A Review of Geometric Transformations for Nonrigid Body Registration , 2008, IEEE Transactions on Medical Imaging.

[52]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..