Breathing life into shape

Modeling how the human body deforms during breathing is important for the realistic animation of lifelike 3D avatars. We learn a model of body shape deformations due to breathing for different breathing types and provide simple animation controls to render lifelike breathing regardless of body shape. We capture and align high-resolution 3D scans of 58 human subjects. We compute deviations from each subject's mean shape during breathing, and study the statistics of such shape changes for different genders, body shapes, and breathing types. We use the volume of the registered scans as a proxy for lung volume and learn a novel non-linear model relating volume and breathing type to 3D shape deformations and pose changes. We then augment a SCAPE body model so that body shape is determined by identity, pose, and the parameters of the breathing model. These parameters provide an intuitive interface with which animators can synthesize 3D human avatars with realistic breathing motions. We also develop a novel interface for animating breathing using a spirometer, which measures the changes in breathing volume of a "breath actor".

[1]  Michael J. Black,et al.  FAUST: Dataset and Evaluation for 3D Mesh Registration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Isabelle Bloch,et al.  Thoracic CT-PET Registration Using a 3D Breathing Model , 2007, MICCAI.

[3]  Jessica K. Hodgins,et al.  Data-driven modeling of skin and muscle deformation , 2008, SIGGRAPH 2008.

[4]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[5]  Pierre Baconnier,et al.  Physically-based model for simulating the human trunk respiration movements , 1997, CVRMed.

[6]  Ken Jackson,et al.  Modeling and Simulation of Skeletal Muscle for Computer Graphics: A Survey , 2012, Found. Trends Comput. Graph. Vis..

[7]  Victor B. Zordan,et al.  Laughing out loud: control for modeling anatomically inspired laughter using audio , 2008, SIGGRAPH 2008.

[8]  Sung Yong Shin,et al.  Example‐based motion cloning , 2004, Comput. Animat. Virtual Worlds.

[9]  Marcus A. Magnor,et al.  Capture and Statistical Modeling of Arm‐Muscle Deformations , 2013, Comput. Graph. Forum.

[10]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[11]  Marta Cavagnaro,et al.  Anatomical models of breathing subjects for absorption and scattering analysis , 2013, 2013 International Symposium on Electromagnetic Compatibility.

[12]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, ACM Trans. Graph..

[13]  Sebastian Thrun,et al.  Video-based reconstruction of animatable human characters , 2010, ACM Trans. Graph..

[14]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[15]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[16]  Zoltan Kato,et al.  Correspondence-Less Non-rigid Registration of Triangular Surface Meshes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[18]  Sumanta N. Pattanaik,et al.  Physiologically-based modeling and visualization of deformable lungs , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[19]  Jovan Popovic,et al.  Example-based control of human motion , 2004, SCA '04.

[20]  Remco C. Veltkamp,et al.  A Physiological Torso Model for Realistic Breathing Simulation , 2009, 3DPH.

[21]  Eftychios Sifakis,et al.  Comprehensive biomechanical modeling and simulation of the upper body , 2009, TOGS.

[22]  Michael J. Black,et al.  Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape , 2012, ECCV.

[23]  Zicheng Liu,et al.  Tensor-Based Human Body Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  John B. West,et al.  Respiratory Physiology - the Essentials , 1979 .

[25]  Nadia Magnenat-Thalmann,et al.  Personalised real-time idle motion synthesis , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[26]  Nadia Magnenat-Thalmann,et al.  Recent Advances in the 3D Physiological Human , 2009, Recent Advances in the 3D Physiological Human.

[27]  Joachim Hornegger,et al.  Robust real-time 3D respiratory motion detection using time-of-flight cameras , 2008, International Journal of Computer Assisted Radiology and Surgery.

[28]  F. Léon-Velarde,et al.  Respiratory Physiology , 2018, People and Ideas.

[29]  B. N. Barman Laughing , Crying , Sneezing and Yawning : Automatic Voice Dr iven Animation of Non-Speech Articulations ∗ , 2006 .

[30]  Kathleen M. Robinette,et al.  Civilian American and European Surface Anthropometry Resource (CAESAR), Final Report. Volume 1. Summary , 2002 .

[31]  Aaron Hertzmann,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Learning a Correlated Model of Identity and Pose-dependent Body Shape Variation for Real-time Synthesis , 2022 .

[32]  Victor Zordan,et al.  Toward Anatomical Simulation for Breath Training in Mind/Body Medicine , 2009, Recent Advances in the 3D Physiological Human.

[33]  Joseph T. Kider,et al.  A data-driven appearance model for human fatigue , 2011, SCA '11.