3D modeling of the human upper limb including the biomechanics of joints, muscles and soft tissues

The challenge in virtual human modeling is to achieve the representation of the main human characteristics with as much realism as possible. Such achievements would allow the simulation and/or analysis of many virtual situations involving humans. Simulation is especially useful to derive information from the models so as to predict and/or reproduce the behaviors that would be observed in real situations. Computer methods in visualization and simulation have thus great potential for advances in medicine. The processes of strength generation and motion coordination are some of these phenomena for which there is still much remaining to be understood. The human shoulder is also probably the articulation of the human body which deserves more than any other to be named "terra incognita". Investigations towards the biomechanical modeling and simulation of the human upper limb are therefore presented in this study. It includes thorough investigation into the musculoskeletal anatomy and biomechanics of the human upper limb, into the biomechanical constitutive modeling of muscles and soft tissues, and into the nonlinear continuum mechanics and numerical methods, especially the incremental finite element methods, necessary for their simulation. On this basis, a 3-D biomechanical musculoskeletal human upper limb model has been designed using the Visible Human Data provided by the U.S. National Library of Medicine, and applied to the dynamic musculoskeletal simulation of the human upper limb. This research has been achieved in the context of the EU ESPRIT Project CHARM, whose objective has been to develop a comprehensive human animation resource database and a set of software tools allowing the modeling of the human complex musculoskeletal system and the simulation of its dynamics, including the finite element simulation of soft tissue deformation and muscular contraction. An investigation towards the application of this knowledge for the realistic modeling and animation of the upper limb in computer animation is then presented. The anatomical and biomechanical modeling of the scapulo-thoracic constraint and the shoulder joint sinus cones are proposed and applied to the realistic animation, using inverse kinematics, of a virtual skeleton and an anatomic musculoskeletal body model.

[1]  Gijs Pronk The shoulder girdle, analysed and modelled kinematically , 1991 .

[2]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[3]  Dave Sims Putting the Visibie Human to Work [Applications] , 1996, IEEE Computer Graphics and Applications.

[4]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  A. Grimm,et al.  Deformation of the diastolic left ventricle. Nonlinear elastic effects. , 1973, Biophysical journal.

[6]  S. Woo,et al.  A structural model to describe the nonlinear stress-strain behavior for parallel-fibered collagenous tissues. , 1989, Journal of biomechanical engineering.

[7]  R. Edlich,et al.  Finite deformation theory for in vivo human skin. , 1977, Journal of bioengineering.

[8]  Y. Lanir The rheological behavior of the skin: experimental results and a structural model. , 1979, Biorheology.

[9]  J. Mcelhaney,et al.  Characterization of the passive responses of live skeletal muscle using the quasi-linear theory of viscoelasticity. , 1994, Journal of biomechanics.

[10]  Y. Youm,et al.  Biomechanical analyses of forearm pronation-supination and elbow flexion-extension. , 1979, Journal of biomechanics.

[11]  F. E. Zajac,et al.  A Dimensionless musculotendon model , 1985 .

[12]  George C. Lee,et al.  Static Finite Deformation Analysis of the Lung , 1978 .

[13]  Allen C. Pipkin Large Deformations with Small Strains , 1986 .

[14]  R. W. Little,et al.  Rheological properties of canine anterior cruciate ligaments. , 1969, Journal of biomechanics.

[15]  A. Capelo,et al.  Study and parameters identification of a rheological model for excised quiescent cardiac muscle. , 1981, Journal of biomechanics.

[16]  Nadia Magnenat-Thalmann,et al.  Topological modeling of human anatomy using medical data , 1995, Proceedings Computer Animation'95.

[17]  S L Woo,et al.  Mathematical modeling of ligaments and tendons. , 1993, Journal of biomechanical engineering.

[18]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[19]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[20]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[21]  G. C. Lee.,et al.  Finite element modeling of lungs including interlobar fissures and the heart cavity. , 1983, Journal of biomechanics.

[22]  A. Grimm,et al.  Deformation of the diastolic left ventricle--II. Nonlinear geometric effects. , 1974, Journal of biomechanics.

[23]  Steven G Massaquoi Evaluation of linear multiinput-multioutput feedback control for a human arm model , 1993 .

[24]  R. W. Snyder Large deformation of isotropic biological tissue. , 1972, Journal of biomechanics.

[25]  Ronan Boulic,et al.  Task-priority formulations for the kinematic control of highly redundant articulated structures , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[26]  Daniel Thalmann,et al.  3D Interactive Topological Modeling using Visible Human Dataset , 1996, Comput. Graph. Forum.

[27]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[28]  Daniel Thalmann,et al.  A dynamic wrinkle model in facial animation and skin ageing , 1995, Comput. Animat. Virtual Worlds.

[29]  I. Sheinman,et al.  Structural three-dimensional constitutive law for the passive myocardium. , 1988, Journal of biomechanical engineering.

[30]  S. Woo,et al.  On the viscoelastic properties of the anteromedial bundle of the anterior cruciate ligament. , 1993, Journal of biomechanics.

[31]  Franck Multon Biomedical Simulation of Human Arm Motion , 1998, ESM.

[32]  E Y Chao,et al.  Three-dimensional rotation of the elbow. , 1978, Journal of biomechanics.

[33]  L. D. Harris,et al.  Finite-element analysis of the strain variations in excised lobe of canine lung. , 1978, Journal of biomechanics.

[34]  Daniel Thalmann,et al.  Modeling using the Visible Human Dataset , 1996 .

[35]  Daniel Thalmann,et al.  Interactive Shape Design Using Metaballs and Splines , 1995 .

[36]  A. Seireg,et al.  Biochemical Analysis Of The Musculoskeletal Structure For Medicine And Sports , 1989 .

[37]  R. Crowninshield,et al.  A physiologically based criterion of muscle force prediction in locomotion. , 1981, Journal of biomechanics.

[38]  Y C Fung,et al.  Measurement of the mechanical properties of the human lung tissue. , 1987, Journal of biomechanical engineering.

[39]  P F Gou,et al.  Strain energy function for biological tissues. , 1970, Journal of biomechanics.

[40]  Anthony A. Maciejewski,et al.  Dealing with the ill-conditioned equations of motion for articulated figures , 1990, IEEE Computer Graphics and Applications.

[41]  David E. Hardt,et al.  Determining Muscle Forces in the Leg During Normal Human Walking—An Application and Evaluation of Optimization Methods , 1978 .

[42]  R. Skalak,et al.  A mathematical model of lung parenchyma. , 1980, Journal of biomechanical engineering.

[43]  F. Buchthal,et al.  The rheology of the cross striated muscle fibre, with particular reference to isotonic conditions , 1951 .

[44]  N. Berme,et al.  The shoulder complex in elevation of the arm: a mechanism approach. , 1978, Journal of biomechanics.

[45]  J. Saunders,et al.  Observations of the Function of the Shoulder Joint , 1996, Clinical orthopaedics and related research.

[46]  P. J. Blatz,et al.  On the Mechanical Behavior of Elastic Animal Tissue , 1969 .

[47]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[48]  Daniel Thalmann,et al.  Modeling and deformation of the human body using an anatomically-based approach , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[49]  Karl Heinz Höhne,et al.  Segmentation of the Visible Human for High Quality Volume Based Visualization , 1996, VBC.

[50]  Y. Fung,et al.  The stress-strain relationship for the skin. , 1976, Journal of biomechanics.

[51]  A E Engin,et al.  On the biomechanics of human shoulder complex--I. Kinematics for determination of the shoulder complex sinus. , 1987, Journal of biomechanics.

[52]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[53]  Marianne Dooley,et al.  Anthropometric Modeling Programs-A Survey , 1982, IEEE Computer Graphics and Applications.

[54]  Daniel Thalmann,et al.  A biomechanical musculoskeletal model of human upper limb for dynamic simulation , 1996 .

[55]  E. Baer,et al.  A structural mechanical model for tendon crimping. , 1980, Journal of biomechanics.

[56]  Daniel Thalmann,et al.  Synthetic Vision and Audition for Digital Actors , 1995, Comput. Graph. Forum.

[57]  D H ELLIOTT,et al.  STRUCTURE AND FUNCTION OF MAMMALIAN TENDON , 1965, Biological reviews of the Cambridge Philosophical Society.

[58]  P J Hunter,et al.  A three-dimensional finite element method for large elastic deformations of ventricular myocardium: II--Prolate spheroidal coordinates. , 1996, Journal of biomechanical engineering.

[59]  Y. Lanir Constitutive equations for the lung tissue. , 1983, Journal of biomechanical engineering.

[60]  A E Engín On the biomechanics of the shoulder complex. , 1980, Journal of biomechanics.

[61]  Demetri Terzopoulos,et al.  Techniques for Realistic Facial Modeling and Animation , 1991 .

[62]  Mary C. Whitton,et al.  Towards Performing Ultrasound-Guided Needle Biopsies from within a Head-Mounted Display , 1996, VBC.

[63]  Irfan Essa,et al.  Physically-based Modeling for Graphics and Vision , 1992 .

[64]  D Karlsson,et al.  Towards a model for force predictions in the human shoulder. , 1992, Journal of biomechanics.

[65]  Nadia Magnenat-Thalmann,et al.  A sys-tem for the parallel integrated motion of multiple deformable human characters with collision , 1995 .

[66]  A D McCulloch,et al.  A three-dimensional finite element method for large elastic deformations of ventricular myocardium: I--Cylindrical and spherical polar coordinates. , 1996, Journal of biomechanical engineering.

[67]  Daniel Thalmann,et al.  Real-time interactions with virtual agents driven by human action identification , 1997, AGENTS '97.

[68]  M L Audu,et al.  A dynamic optimization technique for predicting muscle forces in the swing phase of gait. , 1987, Journal of biomechanics.

[69]  E. Otten A myocybernetic model of the jaw system of the rat. , 1986, Journal of Neuroscience Methods.

[70]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[71]  Lynette A. Jones,et al.  A Teleoperated Microsurgical Robot and Associated Virtual Environment for Eye Surgery , 1993, Presence: Teleoperators & Virtual Environments.

[72]  Y. Lanir Constitutive equations for fibrous connective tissues. , 1983, Journal of biomechanics.

[73]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[74]  J. J. D. Gon,et al.  A biomechanical model for flexion torques of human arm muscles as a function of elbow angle. , 1988 .

[75]  T. McMahon,et al.  A finite element model of the infarcted left ventricle. , 1983, Journal of biomechanics.

[76]  Daniel Thalmann,et al.  Goal-oriented design and correction of articulated figure motion with the TRACK system , 1994, Comput. Graph..

[77]  Daniel Thalmann,et al.  The Direction of Synthetic Actors in the Film Rendez-Vous a Montreal , 1987, IEEE Computer Graphics and Applications.

[78]  B. Neisius,et al.  ‘ Karlsruhe Endoscopic Surgery Trainer ’ A ‘ Virtual Reality ’ based Training System for Minimally Invasive Surgery , 1996 .

[79]  M L Hull,et al.  An activation-recruitment scheme for use in muscle modeling. , 1992, Journal of biomechanics.

[80]  Daniel Thalmann,et al.  Interactive human motion control using a closed-form of direct and inverse dynamics , 1995 .

[81]  S T Tümer,et al.  Three-dimensional kinematic modelling of the human shoulder complex--Part II: Mathematical modelling and solution via optimization. , 1989, Journal of biomechanical engineering.

[82]  D. H. Campen,et al.  The constitutive behaviour of passive heart muscle tissue: a quasi-linear viscoelastic formulation. , 1991, Journal of biomechanics.

[83]  Demetri Terzopoulos,et al.  Modeling inelastic deformation: viscolelasticity, plasticity, fracture , 1988, SIGGRAPH.

[84]  R E Barr,et al.  Development and evaluation of a musculoskeletal model of the elbow joint complex. , 1996, Journal of biomechanical engineering.

[85]  Jack M. Winters,et al.  Modeling Musculoskeletal Movement Systems: Joint and Body Segmental Dynamics, Musculoskeletal Actuation, and Neuromuscular Control , 1990 .

[86]  George Celniker,et al.  Deformable curve and surface finite-elements for free-form shape design , 1991, SIGGRAPH.

[87]  J. Saunders,et al.  Observations on the function of the clavicle. , 1945, California medicine.

[88]  F. V. D. van der Helm,et al.  Modelling the mechanical effect of muscles with large attachment sites: application to the shoulder mechanism. , 1991, Journal of biomechanics.

[89]  Norman I. Badler,et al.  Parametric keyframe interpolation incorporating kinetic adjustment and phrasing control , 1985, SIGGRAPH.

[90]  J. Humphrey,et al.  On constitutive relations and finite deformations of passive cardiac tissue: I. A pseudostrain-energy function. , 1987, Journal of biomechanical engineering.

[91]  H. Demiray A note on the elasticity of soft biological tissues. , 1972, Journal of biomechanics.

[92]  Daniel Thalmann,et al.  The animation of autonomous actors based on production rules , 1996, Proceedings Computer Animation '96.

[93]  T. Feit Diastolic pressure-volume relations and distribution of pressure and fiber extension across the wall of a model left ventricle. , 1979, Biophysical journal.

[94]  Daniel Thalmann,et al.  Towards Autonomous Synthetic Actors , 1993 .

[95]  R. Raikova A general approach for modelling and mathematical investigation of the human upper limb. , 1992, Journal of biomechanics.

[96]  I. Sheinman,et al.  Nonlinear incompressible finite element for simulating loading of cardiac tissue--Part II: Three dimensional formulation for thick ventricular wall segments. , 1988, Journal of biomechanical engineering.

[97]  S C Jacobsen,et al.  Quantitation of human shoulder anatomy for prosthetic arm control--II. Anatomy matrices. , 1989, Journal of biomechanics.

[98]  Loyd M. Myers,et al.  A Modeling and Simulation System for the Human Hand , 1990 .

[99]  A. McCulloch,et al.  Passive material properties of intact ventricular myocardium determined from a cylindrical model. , 1991, Journal of biomechanical engineering.

[100]  Markus Gross,et al.  Simulating facial surgery using finite element models , 1996 .

[101]  F. V. D. van der Helm,et al.  Three-dimensional recording and description of motions of the shoulder mechanism. , 1995, Journal of biomechanical engineering.

[102]  S Sideman,et al.  Nonlinear incompressible finite element for simulating loading of cardiac tissue--Part I: Two dimensional formulation for thin myocardial strips. , 1988, Journal of biomechanical engineering.

[103]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[104]  Y. Fung Elasticity of soft tissues in simple elongation. , 1967, The American journal of physiology.

[105]  D. Vawter,et al.  A finite element model for macroscopic deformation of the lung. , 1980, Journal of biomechanical engineering.

[106]  F. V. D. van der Helm,et al.  Geometry parameters for musculoskeletal modelling of the shoulder system. , 1992, Journal of biomechanics.

[107]  E. Baer,et al.  Collagen; ultrastructure and its relation to mechanical properties as a function of ageing , 1972, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[108]  A. E. Engin ON THE THEORETICAL MODELING OF HUMAN JOINTS , 1984 .

[109]  Hansrudi Noser,et al.  A behavioral animation system based on L-systems ans synthetic sensors for actors , 1997 .

[110]  J. O'Rourke,et al.  A spherical representation of a human body for visualizing movement , 1979, Proceedings of the IEEE.

[111]  Claude Puech,et al.  A modelling system for complex deformable bodies suited to animation and collision processing , 1991, Comput. Animat. Virtual Worlds.

[112]  J. Mcelhaney,et al.  A viscoelastic study of scalp, brain, and dura. , 1970, Journal of biomechanics.