Implementation of Real Time Dress-up System based on Image Blending

ABSTRACT In this paper the real time virtual dress-up system has been proposed. The proposed system consists of multiple tasks including extraction of different body parts, torso detection, resizing input dress images and dress up using blending and re-blending techniques over the subject. The coexistence of different clothing and cluttering backgrounds is the main difficulty for accurate body extraction in image. Haar classifier is applied for detecting face from input frames and geometrical information is used to extract different parts (like a face, a torso, and hands) of a body according to the face position in a frame. Due to the variability of human body, it is complicated to extract accurately. A novel dominant colors based segmentation method is proposed to tackle this problem. First, an image is segmented into uniform areas based on HSV color components. Then, dominant colors of the torso are adaptively selected using color probability model. The torso has been extracted based on the dominant colors to resize the input dress image to fit over the subject body as well as dress size prediction. Automatic dress blending points are calculated on human body using torso starting position and geometrical relationship with face region. A selected dress is scaled and rendered to fit with the subject’s body even they move around. Some preprocessing and post processing techniques are used to make outputs more accurate and realistic.

[1]  Steven Paquette,et al.  3D scanning in apparel design and human engineering , 1996, IEEE Computer Graphics and Applications.

[2]  Hein A.M. Daanen,et al.  Whole body scanners , 1998 .

[3]  Peng Li,et al.  Automated Extraction of Anthropometric Data from 3D Images , 2000 .

[4]  Su-jeong Hwang THREE DIMENSIONAL BODY SCANNING SYSTEMS WITH POTENTIAL FOR USE IN THE APPAREL INDUSTRY , 2001 .

[5]  Karla Peavy Simmons,et al.  BODY MEASUREMENT TECHNIQUES: A COMPARISON OF THREE-DIMENSIONAL BODY SCANNING AND PHYSICAL ANTHROPOMETRIC METHODS , 2001 .

[6]  Jitendra Malik,et al.  Estimating Human Body Configurations Using Shape Context Matching , 2002, ECCV.

[7]  Katsushi Ikeuchi,et al.  Determining reflectance and light position from a single image without distant illumination assumption , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Mun Wai Lee,et al.  Proposal maps driven MCMC for estimating human body pose in static images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[9]  Ig-Jae Kim,et al.  Magic mirror: a new VR platform design and its applications , 2004, ACE '04.

[10]  Alexei A. Efros,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[12]  Jitendra Malik,et al.  Recovering human body configurations using pairwise constraints between parts , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[14]  Gang Hua,et al.  Learning to estimate human pose with data driven belief propagation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Jong-Chul Yoon,et al.  Cartoon-Style Video Generation Using Physical Motion Analysis , 2008 .

[16]  Shree K. Nayar,et al.  Face swapping: automatically replacing faces in photographs , 2008, SIGGRAPH 2008.

[17]  Gavriel Salvendy,et al.  Use of Decision Support for Clothing Products on the Web Results in No Difference in Perception of Tactile Sensation Than Actually Touching the Material , 2008, Int. J. Hum. Comput. Interact..

[18]  Nadia Magnenat-Thalmann,et al.  Automatic modeling of virtual humans and body clothing , 2004, Journal of Computer Science and Technology.

[19]  Jong-Chul Yoon,et al.  Image-based dress up system , 2009, SIGGRAPH '09.

[20]  Marco Furini,et al.  International Journal of Computer and Applications , 2010 .