Animation interactive et modélisation par le dessin : applications pédagogiques en médecine (Interactive Animation and Modeling by Drawing - Pedagogical Applications in Medicine)

Medicine is a discipline where visualization is an essential component of learning. However, the three-dimensional, dynamic structure of the human body poses difficult teaching challenges. There is a need for truly interactive computer tools that will enable students to create and manipulate computer models, not just watch them. We propose different approaches with that goal in mind. We were first interested in interactive physically-based animation of anisotropic elastic materials. One possible application scenario is an anatomy course on heart physiology where students can build interactive samples of cardiac muscular tissue. To achieve this, our model exhibits two key features. The first one is a low computational cost that results in high frame rates; the second one is an intuitive \emph{system image} that ensures easy control by the user. Next, we were interested in interaction in three dimensions using two-dimensional input, either for annotating existing models, or for creating new models; taking advantage of the fact that drawing practice is still considered a fundamental learning method by some anatomy teachers in the French medical school curriculum. Our 3D drawing system has a stroke representation that enables drawing redisplay when the viewpoint changes. Moreover, this representation can be mixed freely with existing polygonal surfaces for annotation purposes. In contrast, our modeling by drawing tool uses information from both stroke geometry and the drawn image, to allow three-dimensional modeling without explicit depth specification.

[1]  Lance Williams,et al.  3D paint , 1990, I3D '90.

[2]  Philip J. Schneider,et al.  Solving the nearest-point-on-curve problem , 1990 .

[3]  Scott F. Johnston Lumo: illumination for cel animation , 2002, NPAR '02.

[4]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[5]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[6]  Michael F. Cohen,et al.  Optimization—an emerging tool in computer graphics , 1994, SIGGRAPH.

[7]  S. Freud The Standard Edition of the Complete Psychological Works of Sigmund Freud , 1953 .

[8]  Mathieu Desbrun,et al.  Interactive multiresolution animation of deformable models , 1999, Computer Animation and Simulation.

[9]  Ronen Barzel,et al.  Physically-based modeling for computer graphics: a structured approach , 1992 .

[10]  M. M. Carroll,et al.  Foundations of Solid Mechanics , 1985 .

[11]  Michael F. Deering,et al.  HoloSketch: a virtual reality sketching/animation tool , 1995, TCHI.

[12]  W. Wang,et al.  A Survey of 3D Solid Reconstruction from 2D Projection Line Drawings , 1993, Comput. Graph. Forum.

[13]  Lee Markosian,et al.  Real-time nonphotorealistic rendering , 1997, SIGGRAPH.

[14]  Christophe Chaillou,et al.  A deformable body model for surgical simulation , 2000, Comput. Animat. Virtual Worlds.

[15]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[16]  François Boux de Casson Simulation dynamique de corps biologiques et changements de topologie interactifs , 2000 .

[17]  Lee Markosian,et al.  An interface for sketching 3D curves , 1999, SI3D.

[18]  Gilles Debunne,et al.  Animation multirésolution d'objets déformables en temps-réel. Application à la simulation chirurgicale. (Real-time multiresolution animation of deformable objects Application to surgery simulation) , 2000 .

[19]  M. Boden The creative mind : myths & mechanisms , 1991 .

[20]  S. Freud Leonardo da Vinci, A Memory of His Childhood , 1910 .

[21]  Gavin S. P. Miller,et al.  The motion dynamics of snakes and worms , 1988, SIGGRAPH.

[22]  Eric Daniels,et al.  Deep canvas in Disney's Tarzan , 1999, SIGGRAPH '99.

[23]  Leonard McMillan,et al.  A projective drawing system , 2001, I3D '01.

[24]  Ernest A. Edmonds,et al.  Interactive systems for supporting the emergence of concepts and ideas , 1997, CHI Extended Abstracts.

[25]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[26]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[27]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[28]  Hironobu Sakaguchi,et al.  Final Fantasy - The Spirits Within , 2001, SIGGRAPH 2001.

[29]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[30]  Pierre Baconnier,et al.  Physically‐Based Deformations Constrained in Displacements and Volume , 1996, Comput. Graph. Forum.

[31]  Victor Ng-Thow-Hing,et al.  Interactive display and animation of B-spline solids as muscle shape primitives , 1997, Computer Animation and Simulation.

[32]  Cornelius W. A. M. van Overveld,et al.  Painting Gradients: Free-form Surface Design Using Shading Patterns , 1996, Graphics Interface.

[33]  Jean Louchet,et al.  Evolutionary identification of cloth animation models , 1995 .

[34]  G. Farin Curves and Surfaces for Cagd: A Practical Guide , 2001 .

[35]  B. Bernard,et al.  Musculoskeletal disorders and workplace factors: a critical review of epidemiologic evidence for work-related musculoskeletal disorders of the neck, upper extremity, and low back , 1997 .

[36]  Daniel Rodríguez,et al.  Adobe Photoshop 7 , 2002 .

[37]  Arie E. Kaufman,et al.  Physically-based animation of volumetric objects , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[38]  SzeliskiRichard,et al.  Surface modeling with oriented particle systems , 1992 .

[39]  John C. Platt,et al.  Constraints methods for flexible models , 1988, SIGGRAPH.

[40]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[41]  Donald A. Norman,et al.  Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine , 1993 .

[42]  Andrew P. Witkin,et al.  Energy constraints on parameterized models , 1987, SIGGRAPH.

[43]  F. Parazza,et al.  Method for the study of the three‐dimensional orientation of the nuclei of myocardial cells in fetal human heart by means of confocal scanning laser microscopy , 1994, Journal of microscopy.

[44]  John F. Hughes,et al.  Harold: a world made of drawings , 2000, NPAR '00.

[45]  Peter J. Hunter,et al.  A virtual environment and model of the eye for surgical simulation , 1994, SIGGRAPH.

[46]  Hiroshi Hashimoto,et al.  Computer Graphics System for Reproducing Three‐ Dimensional Shape from Idea Sketch , 1994, Comput. Graph. Forum.

[47]  Jeff Beall Developing an Interactive Illustration: Using Java and the Web to Make It Worthwhile , 1999 .

[48]  Leonard McMillan,et al.  Sketching with projective 2D strokes , 1999, UIST '99.

[49]  Wolfgang Feiger Head-coupled display systems - Research issues on health aspects , 1995 .

[50]  Fernando Nunes Ferreira,et al.  Sketching 3D models with 2D interaction devices , 1994, Comput. Graph. Forum.

[51]  John Platt,et al.  Heating and melting deformable models (from goop to glop) , 1989 .

[52]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[53]  Jonathan Luskin Man vs. mouse , 1993, SIGGRAPH.

[54]  K. A. Semendyayev,et al.  Handbook of mathematics , 1985 .

[55]  Kay M. Stanney,et al.  Poor Man's Virtual Reality , 1995 .

[56]  David Pugh,et al.  Designing solid objects using interactive sketch interpretation , 1992, I3D '92.

[57]  George Drettakis,et al.  Drawing for Illustration and Annotation in 3D , 2001, Comput. Graph. Forum.

[58]  S. Freud Five lectures on psycho-analysis ; Leonardo da Vinci, and other works , 1957 .

[59]  John C. Platt,et al.  Heating and melting deformable models , 1991, Comput. Animat. Virtual Worlds.

[60]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[61]  HanrahanPat,et al.  Direct WYSIWYG painting and texturing on 3D shapes , 1990 .

[62]  Ramesh Raskar,et al.  Image precision silhouette edges , 1999, SI3D.

[63]  Gershon Elber,et al.  Sketching as a solid modeling tool , 1995, SMA '95.

[64]  Kay M. Stanney,et al.  The psychometrics of cybersickness , 1997, CACM.

[65]  P. Hunter,et al.  Myocardial constitutive laws for continuum mechanics models of the heart. , 1995, Advances in experimental medicine and biology.

[66]  Ilse M. Verstijnen,et al.  Considerations for electronic idea-creation tools , 1996, CHI Conference Companion.

[67]  Mathieu Desbrun,et al.  Smoothed particles: a new paradigm for animating highly deformable bodies , 1996 .

[68]  Hervé Delingette,et al.  Real-Time Large Displacement Elasticity for Surgery Simulation: Non-linear Tensor-Mass Model , 2000, MICCAI.

[69]  David R. Forsey,et al.  How to Render Frames and Influence People , 1994, Comput. Graph. Forum.

[70]  Julie Daily,et al.  3D painting: paradigms for painting in a new dimension , 1995, CHI '95.

[71]  Jean-Daniel Fekete,et al.  Excentric labeling: dynamic neighborhood labeling for data visualization , 1999, CHI '99.

[72]  Claude Cadoz,et al.  Computational Physics : A Modeler - Simulator for animated physical Objects , 1991, Eurographics.

[73]  Andrew P. Witkin,et al.  Fast animation and control of nonrigid structures , 1990, SIGGRAPH.

[74]  Hervé Delingette,et al.  Nonlinear and anisotropic elastic soft tissue models for medical simulation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[75]  James F. O'Brien,et al.  Graphical modeling and animation of ductile fracture , 2002, SIGGRAPH '02.

[76]  Gerald Farin,et al.  NURBS: From Projective Geometry to Practical Use , 1999 .

[77]  V. Goel Sketches of thought , 1995 .

[78]  Mark T. Bolas Human factors in the design of an immersive display , 1994, IEEE Computer Graphics and Applications.

[79]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[80]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[81]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[82]  Gavin S. P. Miller,et al.  Globular dynamics: A connected particle system for animating viscous fluids , 1989, Comput. Graph..

[83]  Marc Olano,et al.  3DM: a three dimensional modeler using a head-mounted display , 1992, I3D '92.

[84]  Peter Schröder,et al.  Surface drawing: creating organic 3D shapes with the hand and tangible tools , 2001, CHI.

[85]  Hans J. Eysenck,et al.  The measurement of creativity. , 1994 .

[86]  Paolo Cignoni,et al.  Computer-Assisted Generation of Bas-and High-Reliefs , 1997, J. Graphics, GPU, & Game Tools.

[87]  Gershon Elber,et al.  Inferring 3D models from freehand sketches and constraints , 1997, Comput. Aided Des..

[88]  John F. Canny,et al.  Real-time and physically realistic simulation of global deformation , 1999, SIGGRAPH '99.

[89]  Song Han,et al.  3DSketch: modeling by digitizing with a smart 3D pen , 1997, MULTIMEDIA '97.

[90]  Brian Mirtich,et al.  A Survey of Deformable Modeling in Computer Graphics , 1997 .

[91]  Aaron Hertzmann,et al.  Illustrating smooth surfaces , 2000, SIGGRAPH.

[92]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[93]  Philip J. Schneider,et al.  An algorithm for automatically fitting digitized curves , 1990 .

[94]  Xavier Provot,et al.  Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior , 1995 .

[95]  Masaki Suwa,et al.  What architects see in their sketches: implications for design tools , 1996, CHI Conference Companion.

[96]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[97]  Andrew Witkin Particle System Dynamics , 1997 .

[98]  Brian Wyvill,et al.  Polygon Inflation for Animated Models: a Method for the Extrusion of Arbitrary Polygon Meshes , 1997, Comput. Animat. Virtual Worlds.

[99]  Andrew Roberts,et al.  3-Draw: a tool for designing 3D shapes , 1991, IEEE Computer Graphics and Applications.

[100]  Bernhard Preim,et al.  Illustrating Anatomic Models - A Semi-Interactive Approach , 1996, VBC.

[101]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[102]  Mathieu Desbrun,et al.  Interactive Animation of Structured Deformable Objects , 1999, Graphics Interface.

[103]  M. Garland,et al.  Fast Polygonal Approximation of Terrains and Height Fields , 1998 .

[104]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[105]  Bill Buxton,et al.  Artists and the art of the luthier , 1997, COMG.

[106]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[107]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[108]  Randy F. Pausch,et al.  A Literature Survey for Virtual Environments: Military Flight Simulator Visual Systems and Simulator Sickness , 1992, Presence: Teleoperators & Virtual Environments.

[109]  Allen Van Gelder,et al.  Approximate Simulation of Elastic Membranes by Triangulated Spring Meshes , 1998, J. Graphics, GPU, & Game Tools.

[110]  Marie-Paule Cani,et al.  Controlling Anisotropy in Mass-Spring Systems , 2000, Computer Animation and Simulation.