Color-blob-based COSFIRE filters for object recognition

Most object recognition methods rely on contour-defined features obtained by edge detection or region segmentation. They are not robust to diffuse region boundaries. Furthermore, such methods do not exploit region color information. We propose color-blob-based COSFIRE (Combination of Shifted Filter Responses) filters to be selective for combinations of diffuse circular regions (blobs) in specific mutual spatial arrangements. Such a filter combines the responses of a certain selection of Difference-of-Gaussians filters, essentially blob detectors, of different scales, in certain channels of a color space, and at certain relative positions to each other. Its parameters are determined/learned in an automatic configuration process that analyzes the properties of a given prototype object of interest. We use these filters to compute features that are effective for the recognition of the prototype objects. We form feature vectors that we use with an SVM classifier. We evaluate the proposed method on a traffic sign (GTSRB) and a butterfly data sets. For the GTSRB data set we achieve a recognition rate of 98.94%, which is slightly higher than human performance and for the butterfly data set we achieve 89.02%. The proposed color-blob-based COSFIRE filters are very effective and outperform the contour-based COSFIRE filters. A COSFIRE filter is trainable, it can be configured with a single prototype pattern and it does not require domain knowledge. Display Omitted We propose novel color-blob-based COSFIRE filters.They are effective for recognizing also objects with diffuse region boundaries.Such a filter models (a part of) an object by a specific arrangement of color blobs.The blobs contain information about the sizes and colors of the interior of regions.We achieve high recognition rates: GTSRB (98.94%) and butterfly (89.02%) data sets.

[1]  Mingjing Li,et al.  Color texture moments for content-based image retrieval , 2002, Proceedings. International Conference on Image Processing.

[2]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Chenyu Shi,et al.  Inhibition-augmented trainable COSFIRE filters for keypoint detection and object recognition , 2016, Machine Vision and Applications.

[4]  Justus H. Piater,et al.  Adaptive Patch Features for Object Class Recognition with Learned Hierarchical Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Bernt Schiele,et al.  Robust Object Detection with Interleaved Categorization and Segmentation , 2008, International Journal of Computer Vision.

[6]  Ioannis Patras,et al.  Combining color and shape information for illumination-viewpoint invariant object recognition , 2006, IEEE Transactions on Image Processing.

[7]  M. McCourt,et al.  In defence of "lateral inhibition" as the underlying cause of induced brightness phenomena: a reply to Spehar, Gilchrist and Arend. , 1997, Vision research.

[8]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[9]  Gregg E. Irvin,et al.  Center/surround relationships of magnocellular, parvocellular, and koniocellular relay cells in primate lateral geniculate nucleus , 1993, Visual Neuroscience.

[10]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[11]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[12]  George Azzopardi,et al.  Ventral-stream-like shape representation: from pixel intensity values to trainable object-selective COSFIRE models , 2014, Front. Comput. Neurosci..

[13]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[14]  Cordelia Schmid,et al.  Semi-Local Affine Parts for Object Recognition , 2004, BMVC.

[15]  Marcel F. Jonkman,et al.  Learning effective color features for content based image retrieval in dermatology , 2011, Pattern Recognit..

[16]  Andrew N. Phillips,et al.  Factors Associated with D-Dimer Levels in HIV-Infected Individuals , 2014, PloS one.

[17]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[18]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  George Azzopardi,et al.  Trainable COSFIRE Filters for Keypoint Detection and Pattern Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Arnold W. M. Smeulders,et al.  Color Based Object Recognition , 1997, ICIAP.

[22]  Bartlett W. Mel.  SEEMORE: Combining Color, Shape, and Texture Histogramming in a Neurally Inspired Approach to Visual Object Recognition , 1997, Neural Computation.

[23]  George Azzopardi,et al.  Gender recognition from face images with trainable COSFIRE filters , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[24]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Nicolai Petkov,et al.  Computational model of dot-pattern selective cells , 2000, Biological Cybernetics.

[26]  Yun Zhang,et al.  A novel biologically inspired local feature descriptor , 2014, Biological Cybernetics.

[27]  Frédéric Jurie,et al.  Latent mixture vocabularies for object categorization and segmentation , 2009, Image Vis. Comput..

[28]  Yongjie Li,et al.  Efficient Color Boundary Detection with Color-Opponent Mechanisms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Marc'Aurelio Ranzato,et al.  Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  A. B. Bonds,et al.  Modeling receptive-field structure of koniocellular, magnocellular, and parvocellular LGN cells in the owl monkey (Aotus trivigatus) , 2002, Visual Neuroscience.

[32]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[33]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[36]  J. Tanaka,et al.  Color diagnosticity in object recognition , 1999, Perception & psychophysics.

[37]  Walter Stechele,et al.  A review of different object recognition methods for the application in driver assistance systems , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[38]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[39]  Daniela Mapelli,et al.  The role of color in object recognition: Evidence from visual agnosia , 1997 .

[40]  Ángel Carmona Poyato,et al.  Keypoint descriptor fusion with Dempster-Shafer theory , 2015, Int. J. Approx. Reason..

[41]  Karl J. Friston,et al.  A direct demonstration of functional specialization in human visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  Fatin Zaklouta,et al.  Traffic sign classification using K-d trees and Random Forests , 2011, The 2011 International Joint Conference on Neural Networks.

[43]  Massimo Bertozzi,et al.  Vision-based intelligent vehicles: State of the art and perspectives , 2000, Robotics Auton. Syst..

[44]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[45]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[47]  P. Lennie,et al.  The machinery of colour vision , 2007, Nature Reviews Neuroscience.

[48]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[49]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[50]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[51]  Michael Biehl,et al.  Adaptive Relevance Matrices in Learning Vector Quantization , 2009, Neural Computation.

[52]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[53]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[54]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories , 2006 .

[55]  Nicolai Petkov,et al.  Modifications of center-surround, spot detection and dot-pattern selective operators , 2005 .

[56]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[57]  Luc Van Gool,et al.  Moment invariants for recognition under changing viewpoint and illumination , 2004, Comput. Vis. Image Underst..

[58]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[59]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[60]  George Azzopardi,et al.  A Push-Pull CORF Model of a Simple Cell with Antiphase Inhibition Improves SNR and Contour Detection , 2014, PloS one.

[61]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[62]  Bevil R. Conway,et al.  Advances in Color Science: From Retina to Behavior , 2010, The Journal of Neuroscience.

[63]  Nicolai Petkov,et al.  Distance sets for shape filters and shape recognition , 2003, IEEE Trans. Image Process..

[64]  George Azzopardi,et al.  Increased generalization capability of trainable COSFIRE filters with application to machine vision , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).