3D Clothes Modeling from Photo Cloned Human Body

An important advantage of virtual reality technology is that real 3D objects including humans can be edited in the virtual world. In this paper, we present a technique for 3D clothes modeling based on a photo cloned human body. Photo cloning is an efficient 3D human body modeling method using a generic body model and photographs. A part segmentation technique for 3D color objects is applied for the clothes modeling, which uses multi-dimensional mixture Gaussians fitting. Firstly, we construct a 6D point set representing both the geometric and color information. Next, the mixture Gaussians are fitted to the point set by using the EM algorithm in order to determine the clusters. This approximation gives probabilities for each point. Finally the probabilities determine the segmented part models corresponding to the clothes models. An advantage of this method is that the clustering is unsupervised learning without any prior knowledge as well as integrating geometric and color data in multi-dimensional space.

[1]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[2]  Jitendra Malik,et al.  Color- and texture-based image segmentation using EM and its application to content-based image retrieval , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[3]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Jack Dongarra,et al.  LAPACK Users' Guide, 3rd ed. , 1999 .

[5]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[6]  Franc Solina,et al.  Superquadrics for Segmenting and Modeling Range Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Daniel Thalmann,et al.  Dressing animated synthetic actors with complex deformable clothes , 1992, SIGGRAPH.

[8]  Alex Pentland,et al.  A Bayesian similarity measure for direct image matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[9]  ISAAC COHEN,et al.  Using deformable surfaces to segment 3-D images and infer differential structures , 1992, CVGIP Image Underst..

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Martin D. Levine,et al.  3D Part Segmentation Using Simulated Electrical Charge Distributions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Guillermo Sapiro,et al.  Minimal Surfaces Based Object Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Ruzena Bajcsy,et al.  Volumetric segmentation of range images of 3D objects using superquadric models , 1993 .

[14]  Wei Sun,et al.  Virtual people: capturing human models to populate virtual worlds , 1999, Proceedings Computer Animation 1999.

[15]  Helen C. Shen,et al.  A 3D Reconstruction System for Human Body Modeling , 1998, CAPTECH.

[16]  Leonard McMillan,et al.  Image-based rendering: A new interface between computer vision and computer graphics , 1999, COMG.

[17]  James Demmel,et al.  LAPACK Users' Guide, Third Edition , 1999, Software, Environments and Tools.

[18]  Neil Gershenfeld,et al.  The nature of mathematical modeling , 1998 .

[19]  Alex Pentland,et al.  Extraction Of Deformable Part Models , 1990, ECCV.

[20]  Alex Pentland,et al.  Closed-Form Solutions for Physically Based Shape Modeling and Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Other Conferences.