Computer modeling, analysis and synthesis of dressed humans

In this paper we present a method for 3-D reconstruction of human bodies with application in CAD systems for garment design. The reconstruction scheme uses image information from several arbitrary views and deformable superquadrics as the models of the body parts. Two visual cues are used: occluding contours and stereo (possibly aided by projected patterns). Our preliminary experiments show that the reconstruction is more complete than in purely stereo or structured light based methods and more precise than the reconstruction from occluding contours only. From the reconstructed human body, the body measurements can be taken automatically, and used in garment design. We give an example of draping of virtual garment over the photo-realistic 3D model of the imaged human. One can easily envision the use of the described algorithms in the development of custom-fit garment retail software over the Internet, which would include the possibility of trying the garment on in virtual reality.

[1]  Daniel Thalmann,et al.  Virtual Human Representation and Communication in VLNet , 1997, IEEE Computer Graphics and Applications.

[2]  Yuan-Fang Wang,et al.  Integration of active and passive sensing techniques for representing three-dimensional objects , 1989, IEEE Trans. Robotics Autom..

[3]  Petia Radeva,et al.  Guidelines for Choosing Optimal OParameters of Elasticity for Snakes , 1995, CAIP.

[4]  J. Skelton.  Fundamentals of Fabric Shear , 1976 .

[5]  Nebojsa Jojic,et al.  On Analysis of Cloth Drape Range Data , 1998, ACCV.

[6]  Richard L. Grimsdale,et al.  Computer graphics techniques for modeling cloth , 1996, IEEE Computer Graphics and Applications.

[7]  G. Borgefors.  Distance transformations in arbitrary dimensions , 1984 .

[8]  Helen C. Shen,et al.  3-D Reconstruction of Multipart Self-Occluding Objects , 1998, ACCV.

[9]  Ioannis A. Kakadiaris,et al.  Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Daniel Thalmann,et al.  Dressing animated synthetic actors with complex deformable clothes , 1992, SIGGRAPH.

[11]  Ioannis Athanassiou Kakadiaris.  Motion-based part segmentation, shape and motion estimation of multi-part objects , 1997 .

[12]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[13]  Billie J. Collier,et al.  Drape Prediction by Means of Finite-element Analysis , 1991 .

[14]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[17]  David E. Breen,et al.  Predicting the drape of woven cloth using interacting particles , 1994, SIGGRAPH.

[18]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[19]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Richard L. Grimsdale,et al.  A system for modelling and visualization of cloth material , 1995, Comput. Graph..

[21]  Andrew E. Johnson,et al.  Supporting transcontinental collaborative work in persistent virtual environments , 1996, IEEE Computer Graphics and Applications.

[22]  Ying Yang,et al.  An improved algorithm for collision detection in cloth animation with human body , 1993 .

[23]  D. W. Lloyd,et al.  Characterizing the Elastic Behavior of Textile Fabrics in Complex Deformations , 1978 .

[24]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[25]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[26]  Wolfgang Straßer,et al.  A fast, flexible, particle-system model for cloth draping , 1996, IEEE Computer Graphics and Applications.

[27]  Alex Pentland,et al.  Perceptual Organization and the Representation of Natural Form , 1986, Artif. Intell..

[28]  Ioannis A. Kakadiaris,et al.  3D human body model acquisition from multiple views , 1995, Proceedings of IEEE International Conference on Computer Vision.

[29]  Ramin Samadani.  Adaptive snakes: control of damping and material parameters , 1991, Optics & Photonics.