A Novel Multi-Feature Representation of Images for Heterogeneous IoTs

With the applications heterogeneous of Internet of Things (IoT) technology, the heterogeneous IoT systems generate a large number of heterogeneous datas, including videos and images. How to efficiently represent these images is an important and challenging task. As a local descriptor, the texton analysis has attracted wide attentions in the field of image processing. A variety of texton-based methods have been proposed in the past few years, which have achieved excellent performance. But, there still exists some problems to be solved, especially, it is difficult to describe the images with complex scenes from IoT. To address this problem, this paper proposes a multi-feature representation method called diagonal structure descriptor. It is more suitable for intermediate feature extraction and conducive to multi-feature fusion. Based on visual attention mechanism, five kinds of diagonal structure textons are defined by the color differences of diagonal pixels. Then, four types of visual features are extracted from the mapping sub-graphs and integrated into 1-D vector. Various experiments on three Corel-datasets demonstrate that the proposed method performs better than several state-of-the-art methods.

[1]  Yu Zhou,et al.  An Efficient Multi-Path Self-Organizing Strategy in Internet of Things , 2013, Wirel. Pers. Commun..

[2]  Feng Xia,et al.  A greedy model with small world for improving the robustness of heterogeneous Internet of Things , 2016, Comput. Networks.

[3]  Lin Feng,et al.  Metric learning with geometric mean for similarities measurement , 2015, Soft Computing.

[4]  Jingyu Yang,et al.  Image retrieval based on the texton co-occurrence matrix , 2008, Pattern Recognit..

[5]  Xingming Sun,et al.  Achieving Efficient Cloud Search Services: Multi-Keyword Ranked Search over Encrypted Cloud Data Supporting Parallel Computing , 2015, IEICE Trans. Commun..

[6]  Subrahmanyam Murala,et al.  Local extrema co-occurrence pattern for color and texture image retrieval , 2015, Neurocomputing.

[7]  Tieniu Tan,et al.  Feature Coding in Image Classification: A Comprehensive Study , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[9]  Xingyuan Wang,et al.  The method for image retrieval based on multi-factors correlation utilizing block truncation coding , 2014, Pattern Recognit..

[10]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[11]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[12]  Subrahmanyam Murala,et al.  Joint histogram between color and local extrema patterns for object tracking , 2013, Electronic Imaging.

[13]  R Sridevi,et al.  A Novel Watershed Image Segmentation Technique using Graceful Labeling , 2013, SOCO 2013.

[14]  Jian Dong,et al.  Contextualizing Object Detection and Classification , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[16]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[17]  Tinghuai Ma,et al.  Social Network and Tag Sources Based Augmenting Collaborative Recommender System , 2015, IEICE Trans. Inf. Syst..

[18]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[19]  Bernd Girod,et al.  CHoG: Compressed histogram of gradients A low bit-rate feature descriptor , 2009, CVPR.

[20]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[21]  Xingyuan Wang,et al.  A novel method for image retrieval based on structure elements' descriptor , 2013, J. Vis. Commun. Image Represent..

[22]  Soojin Kim,et al.  Fast Calculation of Histogram of Oriented Gradient Feature by Removing Redundancy in Overlapping Block , 2014, J. Inf. Sci. Eng..

[23]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[24]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[25]  Adrian G. Bors,et al.  Image retrieval based on query by saliency content , 2015, Digit. Signal Process..

[26]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[27]  Subrahmanyam Murala,et al.  Directional local extrema patterns: a new descriptor for content based image retrieval , 2012, International Journal of Multimedia Information Retrieval.

[28]  Ibrahim S. I. Abuhaiba,et al.  Improved Image Retrieval with Color and Angle Representation , 2014 .

[29]  Shyam Krishna Nagar,et al.  Multi-joint histogram based modelling for image indexing and retrieval , 2014, Comput. Electr. Eng..

[30]  Xingming Sun,et al.  Enabling Personalized Search over Encrypted Outsourced Data with Efficiency Improvement , 2016, IEEE Transactions on Parallel and Distributed Systems.

[31]  Dimitrios Charalampidis,et al.  Texture synthesis: textons revisited , 2006, IEEE Transactions on Image Processing.

[32]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[33]  Yongdong Zhang,et al.  Full-Space Local Topology Extraction for Cross-Modal Retrieval , 2015, IEEE Transactions on Image Processing.