Local Geometry Feature Extraction for Face Sketch Recognition

In this paper, we present a new feature extraction approach for face sketch recognition. Based on the assumption that small image patches in the photo and sketch images form manifold with similar local geometry in two different image spaces, we propose local geometry feature extraction approach to reduce the modality gap between photos and sketches. Considering the impact of different scale to performance, we further propose multi-scale ensemble to improve the performance and avoid scale selection problem. Experimental results on CUFS database show that our method outperforms those state-of-the-art methods. Moreover, it also has a big advantage that it does not need any training procedure.

[1]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[2]  Chunna Tian,et al.  Face Sketch Synthesis using E-HMM and Selective Ensemble , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[3]  Xiaogang Wang,et al.  Face Photo-Sketch Synthesis and Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Stan Z. Li,et al.  Coupled Spectral Regression for matching heterogeneous faces , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Xiaogang Wang,et al.  Face sketch recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Hanqing Lu,et al.  A nonlinear approach for face sketch synthesis and recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Chunna Tian,et al.  Face Sketch Synthesis Algorithm Based on E-HMM and Selective Ensemble , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  D. D. Ridder,et al.  Locally linear embedding for classification , 2002 .

[9]  Dahua Lin,et al.  Inter-modality Face Recognition , 2006, ECCV.

[10]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[11]  Xiaogang Wang,et al.  Face sketch synthesis and recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  王晓刚,et al.  Coupled Information-Theoretic Encoding for Face Photo-Sketch Recognition , 2011 .

[13]  Anil K. Jain,et al.  Sketch-to-photo matching: a feature-based approach , 2010, Defense + Commercial Sensing.

[14]  Xuelong Li,et al.  Local face sketch synthesis learning , 2008, Neurocomputing.