Recent advances on virtual human synthesis

Virtual human is a digital representation of the geometric and behavioral property of human beings in the virtual environment generated by computer. The research goal of virtual human synthesis is to generate realistic human bodymodels and natural human motion behavior. This paper introduces the development of the related researches on these two topics, and some progresses on example based human modeling and motion synthesis, and their applications in Chinese sign language teaching, computeraided sports training and public safety problem studying. Finally, some hot research topics in virtual human synthesis are presented.

[1]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[2]  Zhaoqi Wang.  3D Human Motion Simulation and a Video Analysis System for Sports Training , 2005 .

[3]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, ACM Trans. Graph..

[4]  Siddhartha S. Srinivasa,et al.  Physics-based motion retiming , 2006, SCA '06.

[5]  Daniel E. Whitney,et al.  Resolved Motion Rate Control of Manipulators and Human Prostheses , 1969 .

[6]  Roy Featherstone,et al.  Robot Dynamics Algorithms , 1987 .

[7]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[8]  Wayne E. Carlson,et al.  Anatomy-based modeling of the human musculature , 1997, SIGGRAPH.

[9]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[10]  Xia Shi.  Physics-Based Simulation of Human Motion in Flight , 2008 .

[11]  Norman I. Badler,et al.  Inverse kinematics positioning using nonlinear programming for highly articulated figures , 1994, TOGS.

[12]  Tak,et al.  EXAMPLE GUIDED INVERSE KINEMATICS , .

[13]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[14]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[15]  Zhaoqi Wang,et al.  A Pose-Independent Method of Animating Scanned Human Bodies , 2008 .

[16]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[17]  Gaojin Wen,et al.  Least-squares fitting of multiple M-dimensional point sets , 2006, The Visual Computer.

[18]  Michael F. Cohen,et al.  Controlling dynamic simulation with kinematic constraints , 1987, SIGGRAPH.

[19]  Michael F. Cohen,et al.  Hierarchical Spacetime Control of Linked Figures , 1998 .

[20]  Zicheng Liu,et al.  Efficient animation techniques balancing both user control and physical realism , 1996 .

[21]  Fetter,et al.  A Progression of Human Figures Simulated by Computer Graphics , 1982, IEEE Computer Graphics and Applications.

[22]  Zhaoqi Wang,et al.  A novel framework for athlete training based on interactive motion editing and silhouette analysis , 2005, VRST '05.

[23]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[24]  Michael F. Cohen,et al.  Interactive spacetime control for animation , 1992, SIGGRAPH.

[25]  D Thalmann,et al.  An Overview of Virtual Humans , 2004 .

[26]  Daniel Thalmann,et al.  MuscleBuilder: A modeling tool for human anatomy , 2008, Journal of Computer Science and Technology.

[27]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[28]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[29]  Jane Wilhelms,et al.  Using Dynamic Analysis for Realistic Animation of Articulated Bodies , 1987, IEEE Computer Graphics and Applications.

[30]  Jessica K. Hodgins,et al.  Simulation of human running , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[31]  Zhaoqi Wang,et al.  Pose Synthesis Using the Inverse of Jacobian Matrix Learned from Examples , 2007, 2007 IEEE Virtual Reality Conference.

[32]  Jovan Popovic,et al.  Adaptation of performed ballistic motion , 2005, TOGS.

[33]  Hui Zhang,et al.  Realistic modeling and animation of human body based on scanned data , 2008, Journal of Computer Science and Technology.

[34]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[35]  David Zeltzer,et al.  Dynamic simulation of autonomous legged locomotion , 1990, SIGGRAPH.

[36]  D. Thalmann,et al.  Handbook of Virtual Humans: Magnenat-Thalma/Handbook of Virtual Humans , 2006 .

[37]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[38]  Li Yan,et al.  A Survey of Virtual Human Skin Deformation , 2005 .

[39]  Gaojin Wen,et al.  From motion capture data to character animation , 2006, VRST '06.

[40]  Jane Wilhelms,et al.  Anatomically based modeling , 1997, SIGGRAPH.

[41]  Charles W. Wampler,et al.  Manipulator Inverse Kinematic Solutions Based on Vector Formulations and Damped Least-Squares Methods , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[42]  탁세윤,et al.  Example Guided Inverse Kinematics , 1999 .

[43]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[44]  Jessica K. Hodgins,et al.  Generating natural-looking motion for computer animation , 1992 .

[45]  Wang Zhaoqi.  Point-Based Rendering of Large-Scale 3D Models , 2007 .

[46]  Wang Zhaoqi,et al.  A Virtual-Real Comparision Method Used for Sport Simulation and Analysis , 2005 .

[47]  John M. Hollerbach,et al.  A Recursive Lagrangian Formulation of Maniputator Dynamics and a Comparative Study of Dynamics Formulation Complexity , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[48]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[49]  Philip C. Treleaven,et al.  Building symbolic information for 3D human body modeling from range data , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[50]  Li Chun.  Inverse Kinematics Using Local Support Poses , 2007 .

[51]  Nadia Magnenat-Thalmann,et al.  Synthesizing animatable body models with parameterized shape modifications , 2003, SCA '03.

[52]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH 2006.

[53]  J. O'Rourke,et al.  A spherical representation of a human body for visualizing movement , 1979, Proceedings of the IEEE.

[54]  Zhaoqi Wang,et al.  CrowdViewer: from simple script to large-scale virtual crowds , 2007, VRST '07.

[55]  Taku Komura,et al.  An inverse kinematics method for 3D figures with motion data , 2003, Proceedings Computer Graphics International 2003.

[56]  Wei Sun,et al.  Virtual people: capturing human models to populate virtual worlds , 1999, Proceedings Computer Animation 1999.

[57]  Brian Guenter,et al.  Efficient symbolic differentiation for graphics applications , 2007, SIGGRAPH 2007.

[58]  Qinping Zhao,et al.  A survey on virtual reality , 2009, Science in China Series F: Information Sciences.

[59]  Eugene Fiume,et al.  Limit cycle control and its application to the animation of balancing and walking , 1996, SIGGRAPH.

[60]  William W. Armstrong,et al.  The dynamics of articulated rigid bodies for purposes of animation , 1985, The Visual Computer.

[61]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[62]  Daniel Thalmann,et al.  Handbook of Virtual Humans , 2004 .

[63]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[64]  Jessica K. Hodgins,et al.  Animation of dynamic legged locomotion , 1991, SIGGRAPH.

[65]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[66]  Dengming Zhu,et al.  A robust method for analyzing the physical correctness of motion capture data , 2006, VRST '06.

[67]  Robert Lake,et al.  Near-Real-Time Control of Human Figure Models , 1987, IEEE Computer Graphics and Applications.

[68]  Parviz E. Nikravesh,et al.  Computer-aided analysis of mechanical systems , 1988 .

[69]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[71]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[72]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[73]  Wang Jie,et al.  Hierarchical Obstacle Avoidance for Crowd Simulation , 2007 .

[74]  C. Karen Liu,et al.  Composition of complex optimal multi-character motions , 2006, SCA '06.

[75]  Daniel Thalmann,et al.  Computer Animation , 1990, Computer Science Workbench.

[76]  Xiugan Yuan,et al.  Computational simulation of human motion based on comfort level maximization , 2005 .

[77]  Jovan Popovic,et al.  Guided time warping for motion editing , 2007, SCA '07.

[78]  Z. Popovic,et al.  Motion transformation by physically based spacetime optimization , 1999 .

[79]  Long Quan,et al.  Image deblurring with blurred/noisy image pairs , 2007, SIGGRAPH 2007.

[80]  Wang Zhaoqi.  A Method to Synthesize Chinese Sign Language Based on Virtual Human Technologies , 2002 .

[81]  Richard E. Parent,et al.  Automated generation of control skeletons for use in animation , 2002, The Visual Computer.

[82]  Jeffrey Smith,et al.  Three applications of optimization in computer graphics , 2003 .

[83]  David E. Orin,et al.  Robot dynamics: equations and algorithms , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[84]  Michael Patrick Johnson,et al.  Exploiting quaternions to support expressive interactive character motion , 2003 .

[85]  Masaki Oshita,et al.  A Dynamic Motion Control Technique for Human‐like Articulated Figures , 2001, Comput. Graph. Forum.