Trustful Internet of Surveillance Things Based on Deeply Represented Visual Co-Saliency Detection

Trustful Internet of Things (IoT) plays an important role in smart cities. The trust information in surveillance data motivates the analysis of images from numerous IoT devices. Saliency detection is a fundamental step in surveillance data analysis for providing help to the subsequent tasks, but unsuitable to IoT applications owing to the neglect of image similarity and difference from diverse IoT devices. To solve this problem, we enable the co-saliency detection in IoT, which detects the common and salient foreground regions in the group surveillance images. The main contributions include: 1) enable a multistage context perception scheme to efficiently extract the contextual information corresponding to different-size receptive fields in the single image; 2) construct a two-path information propagation to extract the interimage similarity and difference from the high-level image feature representations of the group images; and 3) propose the stage-wise refinement to allocate the label information to different parts of the network for helping the network to learn the enriched semantically common knowledge. The extensive experiments performed on three public data sets can demonstrate the effectiveness of our approach and its superiority to four state-of-the-art co-saliency detection methods.

[1]  Jianwen Luo,et al.  Learning the implicit strain reconstruction in ultrasound elastography using privileged information , 2019, Medical Image Anal..

[2]  Xuelong Li,et al.  A Review of Co-Saliency Detection Algorithms , 2018 .

[3]  Huchuan Lu,et al.  A Stagewise Refinement Model for Detecting Salient Objects in Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  King Ngi Ngan,et al.  Co-Salient Object Detection From Multiple Images , 2013, IEEE Transactions on Multimedia.

[5]  Jiannong Cao,et al.  CTRUST: A Dynamic Trust Model for Collaborative Applications in the Internet of Things , 2019, IEEE Internet of Things Journal.

[6]  Jiangtao Wang,et al.  Crowd-Powered Sensing and Actuation in Smart Cities: Current Issues and Future Directions , 2018, IEEE Wireless Communications.

[7]  Wenjia Li,et al.  Policy-Based Secure and Trustworthy Sensing for Internet of Things in Smart Cities , 2018, IEEE Internet of Things Journal.

[8]  Xiaojiang Du,et al.  Privacy-Preserving Image Retrieval for Medical IoT Systems: A Blockchain-Based Approach , 2019, IEEE Network.

[9]  Xuelong Li,et al.  Detection of Co-salient Objects by Looking Deep and Wide , 2016, International Journal of Computer Vision.

[10]  Xiaochun Cao,et al.  Cluster-Based Co-Saliency Detection , 2013, IEEE Transactions on Image Processing.

[11]  Jia Guo,et al.  A survey of trust computation models for service management in internet of things systems , 2017, Comput. Commun..

[12]  Fei Wu,et al.  Group-wise Deep Co-saliency Detection , 2017, IJCAI.

[13]  Dong Liang,et al.  Motion Tracking of the Carotid Artery Wall From Ultrasound Image Sequences: a Nonlinear State-Space Approach , 2018, IEEE Transactions on Medical Imaging.

[14]  Mohsen Guizani,et al.  Privacy-Preserving Support Vector Machine Training Over Blockchain-Based Encrypted IoT Data in Smart Cities , 2019, IEEE Internet of Things Journal.

[15]  Chao Li,et al.  A Self-Paced Multiple-Instance Learning Framework for Co-Saliency Detection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Arun Kumar Sangaiah,et al.  A Robust Features-Based Person Tracker for Overhead Views in Industrial Environment , 2018, IEEE Internet of Things Journal.

[17]  Chang-Tsun Li,et al.  Video Anomaly Detection With Compact Feature Sets for Online Performance , 2017, IEEE Transactions on Image Processing.

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Md Zakirul Alam Bhuiyan,et al.  A Secure IoT Service Architecture With an Efficient Balance Dynamics Based on Cloud and Edge Computing , 2019, IEEE Internet of Things Journal.

[21]  Zhi Liu,et al.  RGBD co-saliency detection via multiple kernel boosting and fusion , 2017, Multimedia Tools and Applications.

[22]  Xiaojiang Du,et al.  Achieving Efficient and Secure Data Acquisition for Cloud-Supported Internet of Things in Smart Grid , 2017, IEEE Internet of Things Journal.

[23]  Guang Yang,et al.  SaliencyGAN: Deep Learning Semisupervised Salient Object Detection in the Fog of IoT , 2020, IEEE Transactions on Industrial Informatics.

[24]  Hsiao-Hwa Chen,et al.  An Energy-Aware Trust Derivation Scheme With Game Theoretic Approach in Wireless Sensor Networks for IoT Applications , 2014, IEEE Internet of Things Journal.

[25]  Hyunbum Kim,et al.  Designing UAV Surveillance Frameworks for Smart City and Extensive Ocean with Differential Perspectives , 2018, IEEE Communications Magazine.

[26]  Dong Xu,et al.  Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey , 2018, IEEE Signal Processing Magazine.

[27]  Heye Zhang,et al.  Privileged Modality Distillation for Vessel Border Detection in Intracoronary Imaging , 2019, IEEE Transactions on Medical Imaging.

[28]  Heye Zhang,et al.  A Meshfree Representation for Cardiac Medical Image Computing , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[29]  Jingchang Huang,et al.  A Crowdsource-Based Sensing System for Monitoring Fine-Grained Air Quality in Urban Environments , 2019, IEEE Internet of Things Journal.

[30]  Joongheon Kim,et al.  Internet of Things for Smart Manufacturing System: Trust Issues in Resource Allocation , 2018, IEEE Internet of Things Journal.

[31]  Victor C. M. Leung,et al.  Blockchain-Based Decentralized Trust Management in Vehicular Networks , 2019, IEEE Internet of Things Journal.

[32]  Xiaochun Cao,et al.  Self-Adaptively Weighted Co-Saliency Detection via Rank Constraint , 2014, IEEE Transactions on Image Processing.

[33]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[34]  Guang Yang,et al.  Deep Learning intra-image and inter-images features for Co-saliency detection , 2018, BMVC.

[35]  Zhuowen Tu,et al.  Training Deeper Convolutional Networks with Deep Supervision , 2015, ArXiv.

[36]  Heye Zhang,et al.  Robust estimation of carotid artery wall motion using the elasticity‐based state‐space approach , 2017, Medical Image Anal..

[37]  Heye Zhang,et al.  Learning physical properties in complex visual scenes: An intelligent machine for perceiving blood flow dynamics from static CT angiography imaging , 2019, Neural Networks.

[38]  Giancarlo Fortino,et al.  Evaluating Critical Security Issues of the IoT World: Present and Future Challenges , 2018, IEEE Internet of Things Journal.

[39]  Zhi Liu,et al.  Efficient Saliency-Model-Guided Visual Co-Saliency Detection , 2015, IEEE Signal Processing Letters.

[40]  Wenchang Shi,et al.  A survey on internet of things security from data perspectives , 2019, Comput. Networks.

[41]  Alessandra Mileo,et al.  Observing the Pulse of a City: A Smart City Framework for Real-Time Discovery, Federation, and Aggregation of Data Streams , 2019, IEEE Internet of Things Journal.

[42]  Jiebo Luo,et al.  iCoseg: Interactive co-segmentation with intelligent scribble guidance , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Nicholas I. Fisher,et al.  Statistical Analysis of Circular Data , 1993 .

[44]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[45]  Wenbin Zou,et al.  Co-Saliency Detection Based on Hierarchical Segmentation , 2014, IEEE Signal Processing Letters.

[46]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[47]  Song Wang,et al.  Co-Saliency Detection Within a Single Image , 2018, AAAI.

[48]  Chong-Min Kyung,et al.  Rejecting Motion Outliers for Efficient Crowd Anomaly Detection , 2019, IEEE Transactions on Information Forensics and Security.

[49]  Mohsen Guizani,et al.  Access Control Schemes for Implantable Medical Devices: A Survey , 2017, IEEE Internet of Things Journal.

[50]  Xin Wang,et al.  Salient Object Detection in the Distributed Cloud-Edge Intelligent Network , 2020, IEEE Network.

[51]  W. Marsden I and J , 2012 .

[52]  Victor C. M. Leung,et al.  A Context-Aware Trust-Based Information Dissemination Framework for Vehicular Networks , 2015, IEEE Internet of Things Journal.