A Simple Framework for Face Photo-Sketch Synthesis

This paper proposes a simple framework for face photo-sketch synthesis. We first describe the shadow details on faces and extract the prominent facial feature by two-scale decomposition using bilateral filtering. Then, we enhance the hair and some unapparent facial feature regions by combining the edge map and hair color similarity map. Finally, we obtain the face photo sketch by adding the results of the two processes. Compared with current methods, the proposed framework demands non feature localization, training or iteration process, creating vivid hair in sketch synthesis, and process arbitrary lighting conditions of input images, especially for complex self-shadows. And more importantly, it can be easily expanded to natural scene. The effectiveness of the presented framework is evaluated on a variety of databases.

[1]  Xiaochun Cao,et al.  Identifying Image Composites Through Shadow Matte Consistency , 2011, IEEE Transactions on Information Forensics and Security.

[2]  Ben Weiss,et al.  Fast median and bilateral filtering , 2006, ACM Trans. Graph..

[3]  Niels da Vitoria Lobo,et al.  A framework for recognizing a facial image from a police sketch , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Brian V. Funt,et al.  Investigations into Multi-Scale Retinex , 1998 .

[5]  Nong Sang,et al.  An Automatic Portrait System Based on And-Or Graph Representation , 2007, EMMCVPR.

[6]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[7]  Mark D. Fairchild,et al.  iCAM06, HDR, and Image Appearance , 2007, CIC.

[8]  Zhongjie Wang,et al.  Improved Generalized Belief Propagation for Vision Processing , 2011 .

[9]  Hong Chen,et al.  A high resolution grammatical model for face representation and sketching , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Xiaogang Wang,et al.  Face Photo-Sketch Synthesis and Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[12]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[13]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[14]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[15]  Chunna Tian,et al.  Face Sketch Synthesis Algorithm Based on E-HMM and Selective Ensemble , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  David Salesin,et al.  Image-Based Hair Capture by Inverse Lighting , 2002, Graphics Interface.

[17]  Jenn-Jier James Lien,et al.  Automatic Location of Facial Feature Points and Synthesis of Facial Sketches Using Direct Combined Model , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Xiaochun Cao,et al.  Detecting photographic composites using shadows , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[19]  Hong Chen,et al.  A Hierarchical Compositional Model for Face Representation and Sketching , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[21]  Y F Li,et al.  Determination of Stripe Edge Blurring for Depth Sensing , 2011, IEEE Sensors Journal.

[22]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Xiaogang Wang,et al.  Lighting and Pose Robust Face Sketch Synthesis , 2010, ECCV.

[24]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[25]  Xiaogang Wang,et al.  Face sketch synthesis and recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[26]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[27]  C. Cattani,et al.  Markov Models for Image Labeling , 2012 .

[28]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[29]  T. Metin Sezgin,et al.  Sketch recognition by fusion of temporal and image-based features , 2011, Pattern Recognit..