Image-based control of skin melanin texture.

We introduce a useful tool for controlling the skin melanin texture of facial photographs. Controlling the skin melanin texture is an important task in the reproduction of posters, TV commercials, movies, and so on. We used component maps of melanin, which were obtained by a previous method [J. Opt. Soc. Am. A 16, 2169 (1999)] as the first processing step. We propose to control the melanin texture continuously and physiologically, based on the analysis of 123 skin textures in our database. The physiological validity for the change of the melanin texture is confirmed by comparing the synthesized image with an ultraviolet image, which can be used to predict the change of melanin texture due to aging. The control processes are implemented on programmable graphics hardware, and real-time processing is achieved for a facial videostream.

[1]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[2]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[3]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, ACM Trans. Graph..

[4]  Kristin J. Dana,et al.  Bidirectional imaging and modeling of skin texture , 2004, IEEE Transactions on Biomedical Engineering.

[5]  Andrew Witkin,et al.  Reaction-diffusion textures , 1991, SIGGRAPH.

[6]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[7]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[8]  David H. Laidlaw,et al.  Cellular texture generation , 1995, SIGGRAPH.

[9]  Eero P. Simoncelli,et al.  Texture characterization via joint statistics of wavelet coefficient magnitudes , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[10]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[11]  Steven Worley,et al.  A cellular texture basis function , 1996, SIGGRAPH.

[12]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[13]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.

[14]  Ken Perlin,et al.  An image synthesizer , 1988 .

[15]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[16]  Yanxi Liu,et al.  Deformable texture : the irregular-regular-irregular cycle , 2003 .

[17]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[18]  Marcelo Walter,et al.  Clonal Mosaic Model for the Synthesis of Mammalian Coat Patterns , 1998, Graphics Interface.

[19]  Jean-Michel Dischler,et al.  Interactive Image-based Modeling of Macrostructured Textures , 1999, IEEE Computer Graphics and Applications.

[20]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[21]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[22]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[23]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[24]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[25]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[26]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[27]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[28]  Kristin J. Dana,et al.  3D Texture Recognition Using Bidirectional Feature Histograms , 2004, International Journal of Computer Vision.

[29]  Frédo Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH '05.

[30]  Mitsunori Fukuda,et al.  Rab27A-binding protein Slp2-a is required for peripheral melanosome distribution and elongated cell shape in melanocytes , 2004, Nature Cell Biology.

[31]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[32]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[33]  Norimichi Tsumura,et al.  Independent Component Analysis of Skin Color Image , 1998, CIC.

[34]  Yanxi Liu,et al.  Texture replacement in real images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[35]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.