Textile Retrieval Based on Image Content from CDC and Webcam Cameras in Indoor Environments

Textile based image retrieval for indoor environments can be used to retrieve images that contain the same textile, which may indicate that scenes are related. This makes up a useful approach for law enforcement agencies who want to find evidence based on matching between textiles. In this paper, we propose a novel pipeline that allows searching and retrieving textiles that appear in pictures of real scenes. Our approach is based on first obtaining regions containing textiles by using MSER on high pass filtered images of the RGB, HSV and Hue channels of the original photo. To describe the textile regions, we demonstrated that the combination of HOG and HCLOSIB is the best option for our proposal when using the correlation distance to match the query textile patch with the candidate regions. Furthermore, we introduce a new dataset, TextilTube, which comprises a total of 1913 textile regions labelled within 67 classes. We yielded 84.94% of success in the 40 nearest coincidences and 37.44% of precision taking into account just the first coincidence, which outperforms the current deep learning methods evaluated. Experimental results show that this pipeline can be used to set up an effective textile based image retrieval system in indoor environments.

[1]  Agma J. M. Traina,et al.  PRoSPer: Perceptual similarity queries in medical CBIR systems through user profiles , 2014, Comput. Biol. Medicine.

[2]  Eduardo Fidalgo,et al.  Compass radius estimation for improved image classification using Edge-SIFT , 2016, Neurocomputing.

[3]  Wing-Keung Wong,et al.  Applications of computer vision in fashion and textiles , 2018 .

[4]  Óscar García-Olalla Olivera.  Methods for improving texture description by using statistical information extracted from the image gradient , 2017 .

[5]  Ashok Samal,et al.  A content based image retrieval system for a biological specimen collection , 2010, Comput. Vis. Image Underst..

[6]  Changmin Kim,et al.  Classification of major construction materials in construction environments using ensemble classifiers , 2014, Adv. Eng. Informatics.

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Marcos X. Álvarez-Cid,et al.  Texture Description Through Histograms of Equivalent Patterns , 2012, Journal of Mathematical Imaging and Vision.

[9]  Laura Fernández-Robles,et al.  Local Oriented Statistics Information Booster (LOSIB) for Texture Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[10]  Bo Liu,et al.  Plant Leaf Chlorophyll Content Retrieval Based on a Field Imaging Spectroscopy System , 2014, Sensors.

[11]  Huang-Chia Shih,et al.  SPiraL Aggregation Map (SPLAM): A new descriptor for robust template matching with fast algorithm , 2015, Pattern Recognit..

[12]  Qiang Chen,et al.  Cross-Domain Image Retrieval with a Dual Attribute-Aware Ranking Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Hiroyasu Sakamoto,et al.  Convolutional Recurrent Neural Networks for Better Image Understanding , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[14]  Shuicheng Yan,et al.  Clothes Co-Parsing Via Joint Image Segmentation and Labeling With Application to Clothing Retrieval , 2016, IEEE Transactions on Multimedia.

[15]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[16]  Laura Fernández-Robles,et al.  Evaluation of LBP Variants Using Several Metrics and kNN Classifiers , 2013, SISAP.

[17]  Xiao Wu,et al.  Part-based clothing image annotation by visual neighbor retrieval , 2016, Neurocomputing.

[18]  Yunping Zheng,et al.  A fast region segmentation algorithm on compressed gray images using Non-symmetry and Anti-packing Model and Extended Shading representation , 2016, J. Vis. Commun. Image Represent..

[19]  Paul W. Fieguth,et al.  Extended local binary patterns for texture classification , 2012, Image Vis. Comput..

[20]  László Czúni,et al.  Lightweight Active Object Retrieval with Weak Classifiers , 2018, Sensors.

[21]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[22]  Laura Fernández-Robles,et al.  Vitality Assessment of Boar Sperm Using an Adaptive LBP Based on Oriented Deviation , 2012, ACCV Workshops.

[23]  Jaehoon Jung,et al.  Normalized Metadata Generation for Human Retrieval Using Multiple Video Surveillance Cameras , 2016, Sensors.

[24]  Jun-Wei Hsieh,et al.  Vehicle make and model recognition using sparse representation and symmetrical SURFs , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[25]  Yin-Fu Huang,et al.  Searching Images in a Textile Image Database , 2014, ICSI.

[26]  Svetlana Lazebnik,et al.  Where to Buy It: Matching Street Clothing Photos in Online Shops , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Xiaohua Xie,et al.  Exploiting object semantic cues for Multi-label Material Recognition , 2016, Neurocomputing.

[28]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[29]  Bir Bhanu,et al.  A software system for automated identification and retrieval of moth images based on wing attributes , 2016, Pattern Recognit..

[30]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Bin Li,et al.  Face recognition using locality sensitive histograms of oriented gradients , 2016 .

[32]  Zhenhua Guo,et al.  Rotation invariant texture classification using adaptive LBP with directional statistical features , 2010, 2010 IEEE International Conference on Image Processing.

[33]  J. Andrew Bangham,et al.  Morphological scale-space preserving transforms in many dimensions , 1996, J. Electronic Imaging.

[34]  Min Tan,et al.  Robust object recognition via weakly supervised metric and template learning , 2016, Neurocomputing.

[35]  Francesco Bianconi,et al.  Automatic Characterization of the Visual Appearance of Industrial Materials through Colour and Texture Analysis: An Overview of Methods and Applications , 2013 .

[36]  Ling Liu,et al.  Encyclopedia of Database Systems , 2009, Encyclopedia of Database Systems.

[37]  Eduardo Fidalgo,et al.  Query Based Object Retrieval Using Neural Codes , 2017, SOCO-CISIS-ICEUTE.

[38]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Luis E. Ortiz,et al.  Retrieving Similar Styles to Parse Clothing , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[41]  Huimin Yu,et al.  Unsupervised regions based segmentation using object discovery , 2015, J. Vis. Commun. Image Represent..

[42]  Hang Zhang,et al.  Differential Angular Imaging for Material Recognition , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Laura Fernández-Robles,et al.  Adaptive local binary pattern with oriented standard deviation (ALBPS) for texture classification , 2013, EURASIP J. Image Video Process..

[44]  Michael I. Miller,et al.  Content-based image retrieval for brain MRI: An image-searching engine and population-based analysis to utilize past clinical data for future diagnosis , 2015, NeuroImage: Clinical.

[45]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Virginia Cifuentes,et al.  Un método de optimización proximal al problema de anidamiento de piezas irregulares utilizando arquitecturas en paralelo , 2016 .

[47]  Luis Enrique Sucar,et al.  A Bayesian approach for object classification based on clusters of SIFT local features , 2012, Expert Syst. Appl..

[48]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[49]  S. Domínguez.  Medida de similitud basada en saliencia , 2012 .

[50]  J. J. Wen,et al.  Fundamentals of common computer vision techniques for fashion textile modeling, recognition, and retrieval , 2018 .

[51]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[52]  Anne E. James,et al.  Content-based image retrieval approach for biometric security using colour, texture and shape features controlled by fuzzy heuristics , 2012, J. Comput. Syst. Sci..

[53]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[54]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Jian Yu,et al.  Object recognition via contextual color attention , 2015, J. Vis. Commun. Image Represent..

[56]  Eduardo Fidalgo,et al.  Pornography and child sexual abuse detection in image and video: A comparative evaluation , 2017, ICDP.

[57]  Lingxiao Yang,et al.  Learning object-specific DAGs for multi-label material recognition , 2016, Comput. Vis. Image Underst..

[58]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[59]  C. Krishna Mohan,et al.  Content based medical image retrieval using dictionary learning , 2015, Neurocomputing.

[60]  Zhiwen Liu,et al.  Quaternion generic Fourier descriptor for color object recognition , 2015, Pattern Recognit..

[61]  Junchul Chun,et al.  Textile Image Retrieval Using Composite Feature Vectors of Color and Wavelet Transformed Textural Property , 2013 .

[62]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[63]  Shin'ichi Satoh,et al.  Faster R-CNN Features for Instance Search , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[64]  Dong Xu,et al.  Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey , 2018, IEEE Signal Processing Magazine.

[65]  Md. Khayrul Bashar,et al.  Image retrieval by pattern categorization using wavelet domain perceptual features with LVQ neural network , 2005, Pattern Recognit. Lett..

[66]  M. Jourlin,et al.  A texture descriptor for textile image retrieval , 2009, 2009 International Symposium on Signals, Circuits and Systems.

[67]  Jian Dong,et al.  Deep domain adaptation for describing people based on fine-grained clothing attributes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[68]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[69]  Ioannis Brilakis,et al.  Parameter optimization for automated concrete detection in image data , 2010 .