Recognition of facial sketch styles

Abstract The style recognition of facial sketches drawn by artists contributes great to the painting authentication, digital entertainment and law enforcement. This paper presents a framework to automatically classify different styles of facial sketches based on support vector machines (SVM) and selective ensemble (SE) strategy. Some handwritten features are deployed to feed into SVM classifiers. The framework proceeds as follows: firstly, each geometrically normalized image is divided into five important parts: the whole image, left eye, right eye, nose, and mouth; Secondly, based on the analysis to the technique of the facial sketch artists, gray histogram, gray moment, speeded up robust feature and multiscale local binary patterns are explored to extract handwritten features from each part; Thirdly, SVM is explored to learn the mapping relationship from handwritten features of each part to the style of the artist and thus we obtain multiple classification scores; Finally, we combine these complementary classification scores via SE scheme. Our model is able to achieve the recognition rates of 94% and 96% respectively on two groups of sketches drawn by five artists which would be available on the website.

[1]  Betty Edwards,et al.  The new drawing on the right side of the brain workbook : guided practice in the five basic skills of drawing , 1979 .

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Thomas G. Dietterich Machine-Learning Research , 1997, AI Mag..

[4]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[5]  James Ze Wang,et al.  Studying digital imagery of ancient paintings by mixtures of stochastic models , 2004, IEEE Transactions on Image Processing.

[6]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[7]  Roland Glantz,et al.  Segmentation of brush strokes by saliency preserving dual graph contraction , 2003, Pattern Recognit. Lett..

[8]  Eric O. Postma,et al.  Computer analysis of Van Gogh's complementary colours , 2007, Pattern Recognit. Lett..

[9]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[10]  Xuelong Li,et al.  A Comprehensive Survey to Face Hallucination , 2013, International Journal of Computer Vision.

[11]  Xiaogang Wang,et al.  Face Photo-Sketch Synthesis and Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Riad I. Hammoud,et al.  Estimating the photorealism of images: distinguishing paintings from photographs , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Xuelong Li,et al.  Transductive Face Sketch-Photo Synthesis , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Robert Sablatnig,et al.  Structural analysis of paintings based on brush strokes , 1998, Electronic Imaging.

[15]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  S. Govindarajulu,et al.  A Comparison of SIFT, PCA-SIFT and SURF , 2012 .

[17]  Lambert Schomaker,et al.  Text-Independent Writer Identification and Verification Using Textural and Allographic Features , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  LinLin Shen,et al.  Influence of Wavelet Frequency and Orientation in an SVM-Based Parallel Gabor PCA Face Verification System , 2007, IDEAL.

[19]  Lei Yao,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Rhythmic Brushstrokes Distinguish Van Gogh from His Contemporaries: Findings via Automated Brushstroke Extraction , 2022 .

[20]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[21]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[22]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[23]  Robert Sablatnig,et al.  Hierarchical classification of paintings using face- and brush stroke models , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[24]  Eric O. Postma,et al.  Automatic extraction of brushstroke orientation from paintings , 2008, Machine Vision and Applications.

[25]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[26]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Jia Li,et al.  Image processing for artist identification , 2008, IEEE Signal Processing Magazine.