Tattoo detection based on CNN and remarks on the NIST database

Detecting tattoo images stored in information technology (IT) devices of suspects is an important but challenging task for law enforcement agencies. Recently, the U.S. National Institute of Standards and Technology (NIST) held a challenge and released a tattoo database for the commercial and academic community in advancing research and development into automated image-based tattoo recognition technology. The best tattoo detection result in the NIST challenge was achieved by MorphoTrak with accuracy of 96.3%. This paper aims to answer three questions. 1) Is the NIST database suitable for training algorithms to detect tattoo images stored in IT devices of suspects? 2) Can convolutional neural networks (CNNs) outperform the MorphoTrak's algorithm? 3) How do training databases impact on tattoo detection performance? The NIST tattoo detection database containing 2,349 images and a database containing 10,000 collected from Flickr are utilized to answer these questions. The Flickr images taken in diverse environments and poses are used to simulate images stored in the IT devices. A CNN is trained on the NIST and Flickr images for this study. The experimental results demonstrate that the CNN outperforms the MorphoTrak's algorithm by 2.5%, achieving accuracy of 98.8% on the NIST database. When the CNN is trained on the NIST database to detect Flickr images, the accuracy drops to 65.8%. It implies that the NIST database is not an ideal database for training algorithms to detect tattoo images in IT devices of suspects. However, when the training database size increases, the detection performance improves.

[1]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[2]  Rong Jin,et al.  Unsupervised Ensemble Ranking: Application to Large-Scale Image Retrieval , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Terrance E. Boult,et al.  Exemplar codes for facial attributes and tattoo recognition , 2014, IEEE Winter Conference on Applications of Computer Vision.

[5]  Adams Wai-Kin Kong,et al.  A preliminary report on a full-body imaging system for effectively collecting and processing biometric traits of prisoners , 2014, 2014 IEEE Symposium on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[8]  Rong Jin,et al.  Tattoo-ID: Automatic Tattoo Image Retrieval for Suspect and Victim Identification , 2007, PCM.

[9]  George W. Quinn,et al.  Tattoo Recognition Technology - Challenge (Tatt-C): Outcomes and Recommendations , 2015 .

[10]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[11]  A.K. Jain,et al.  Scars, marks and tattoos (SMT): Soft biometric for suspect and victim identification , 2008, 2008 Biometrics Symposium.

[12]  Terrance E. Boult,et al.  Detecting and classifying scars, marks, and tattoos found in the wild , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[13]  S. Acton,et al.  Matching and Retrieval of Tattoo Images: Active Contour CBIR and Glocal Image Features , 2008, 2008 IEEE Southwest Symposium on Image Analysis and Interpretation.

[14]  Nan Zhao,et al.  Unsupervised tattoo segmentation combining bottom-up and top-down cues , 2011, Defense + Commercial Sensing.

[15]  Anil K. Jain,et al.  Tattoo based identification: Sketch to image matching , 2013, 2013 International Conference on Biometrics (ICB).