Image understanding based on histogram of contrast

An image descriptor based on the orientation of contrasts is proposed to facilitate image understanding. A mathematical function that satisfies the heat equation is proposed to model the parameters of an ideal edge, including the width, contrast, offset, position, and orientation. A simple method can compute the contrast and width of canny edge features. Inspired by the histogram of oriented gradients method, an image representation is proposed based on a histogram of contrasts. The proposed method encodes the weighted orientation in a sub-window. The weighting is based on the contrast instead of the gradient magnitude. Our experiments showed that the new representation was more robust against noise compared with several state-of-the-art methods. Several sub-window resolutions were also considered, which resulted in a pyramid that incorporated the global and local context. A method based on Bayes’ theorem and empirical cumulative distribution function is proposed to predict the probability of correctness for the nearest neighbor classification. The annotation and class label of an image were retrieved using a nearest neighbor method or a support vector machine classifier. This method was tested using several benchmark datasets and toolboxes, which showed that it is suitable for image understanding tasks.

[1]  Chuancai Liu,et al.  An ideal image edge detection scheme , 2014, Multidimens. Syst. Signal Process..

[2]  Alan L. Yuille,et al.  A regularized solution to edge detection , 1985, J. Complex..

[3]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[5]  Xiaochun Yang,et al.  Colorization using edge-preserving smoothing filter , 2014, Signal Image Video Process..

[6]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[7]  James H. Elder,et al.  Are Edges Incomplete? , 1999, International Journal of Computer Vision.

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Yang Yu,et al.  Automatic image annotation using group sparsity , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.