Optimization-Based Offloading and Routing Strategies for Sensor-Enabled Video Surveillance Networks

For the Internet of things, having sensors in devices used for video surveillance services, such as cameras, is crucial. The advancement of edge computing technology has enabled high computing capacity and the handling of massive data sets. The concept of cloudlets is employed in edge computing for in-network processing, especially for large-size multimedia data processing. Cloudlets are essential for services with high computing costs. Contrary to traditional cloud computing, data can be offloaded to in-network devices and core clouds, thereby improving the quality of service and enhancing resource utilization. However, the trade-off between network transmissions and nodal processes with delay-aware multimedia traffic has been demonstrated to be an NP-complete problem. The problem is presented as a mathematical formula to maximize the minimal delay gap between the tolerable event delay, sending time, and processing time. The problem is subject to in-network processing node assignment, routing paths, transmission capacities, computing capacities, and the effective service period. The Lagrangian approach was employed to evaluate the method proposed in this study; a near-optimal solution was obtained, and several experiments were performed to demonstrate that the proposed method outperforms existing methods.

[1]  Markus Voelter,et al.  State of the Art , 1997, Pediatric Research.

[2]  Gian Luca Foresti,et al.  Object recognition and tracking for remote video surveillance , 1999, IEEE Trans. Circuits Syst. Video Technol..

[3]  Marshall L. Fisher,et al.  The Lagrangian Relaxation Method for Solving Integer Programming Problems , 2004, Manag. Sci..

[4]  Yean-Fu Wen,et al.  Multi-sink data aggregation routing and scheduling with dynamic radii in WSNs , 2006, IEEE Communications Letters.

[5]  Dirk Westhoff,et al.  Concealed Data Aggregation for Reverse Multicast Traffic in Sensor Networks: Encryption, Key Distribution, and Routing Adaptation , 2006, IEEE Transactions on Mobile Computing.

[6]  Rita Cucchiara,et al.  Video Streaming for Mobile Video Surveillance , 2008, IEEE Transactions on Multimedia.

[7]  Nicholas True,et al.  Computer Vision Based Fire Detection , 2009 .

[8]  Rahul Sukthankar,et al.  Violence Detection in Video Using Computer Vision Techniques , 2011, CAIP.

[9]  Mohammad S. Obaidat,et al.  Wireless sensor network-based fire detection, alarming, monitoring and prevention system for Bord-and-Pillar coal mines , 2012, J. Syst. Softw..

[10]  Aggelos K. Katsaggelos,et al.  Wireless Video Surveillance: A Survey , 2013, IEEE Access.

[11]  Zeeshan Ahmed,et al.  Image-based Face Detection and Recognition: "State of the Art" , 2013, ArXiv.

[12]  Jong-Hann Jean,et al.  Voting-Based Motion Estimation for Real-Time Video Transmission in Networked Mobile Camera Systems , 2013, IEEE Transactions on Industrial Informatics.

[13]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[14]  Bharadwaj S. Amrutur,et al.  Skip Decision and Reference Frame Selection for Low-Complexity H.264/AVC Surveillance Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Yean-Fu Wen,et al.  Load-balancing metrics: Comparison for infrastructure-based wireless networks , 2014, Comput. Electr. Eng..

[16]  Aurobinda Routray,et al.  Automatic facial expression recognition using features of salient facial patches , 2015, IEEE Transactions on Affective Computing.

[17]  Jörg Henkel,et al.  Computation offloading and resource allocation for low-power IoT edge devices , 2016, 2016 IEEE 3rd World Forum on Internet of Things (WF-IoT).

[18]  Roger Zimmermann,et al.  Dynamic Urban Surveillance Video Stream Processing Using Fog Computing , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).

[19]  Erik Blasch,et al.  Enabling Smart Urban Surveillance at The Edge , 2017, 2017 IEEE International Conference on Smart Cloud (SmartCloud).

[20]  Shaojie Tang,et al.  Lossless In-Network Processing and Its Routing Design in Wireless Sensor Networks , 2017, IEEE Transactions on Wireless Communications.

[21]  Yong Du,et al.  Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks , 2017, IEEE Transactions on Image Processing.

[22]  Rui Dai,et al.  Object-Detection-Based Video Compression for Wireless Surveillance Systems , 2017, IEEE MultiMedia.

[23]  Xianbin Wang,et al.  Live Data Analytics With Collaborative Edge and Cloud Processing in Wireless IoT Networks , 2017, IEEE Access.

[24]  Vlado Stankovski,et al.  Monitoring self-adaptive applications within edge computing frameworks: A state-of-the-art review , 2018, J. Syst. Softw..

[25]  György Dán,et al.  Coordinating Distributed Algorithms for Feature Extraction Offloading in Multi-Camera Visual Sensor Networks , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Yuefeng Ji,et al.  Contextual Bag-of-Words for Robust Visual Tracking , 2018, IEEE Transactions on Image Processing.

[27]  Jiajia Liu,et al.  Collaborative Mobile Edge Computation Offloading for IoT over Fiber-Wireless Networks , 2018, IEEE Network.

[28]  Qiang Ni,et al.  IoT-Driven Automated Object Detection Algorithm for Urban Surveillance Systems in Smart Cities , 2018, IEEE Internet of Things Journal.

[29]  Tao Jiang,et al.  Edge Computing Framework for Cooperative Video Processing in Multimedia IoT Systems , 2018, IEEE Transactions on Multimedia.

[30]  Hammad Afzal,et al.  ARCA-IoT: An Attack-Resilient Cloud-Assisted IoT System , 2019, IEEE Access.

[31]  Kun Xie,et al.  Bandwidth Allocation With Utility Maximization in the Hybrid Segment Routing Network , 2019, IEEE Access.

[32]  Kai Zhang,et al.  ANN-Based Outlier Detection for Wireless Sensor Networks in Smart Buildings , 2019, IEEE Access.

[33]  Adnan Yazici,et al.  A Fusion-Based Framework for Wireless Multimedia Sensor Networks in Surveillance Applications , 2019, IEEE Access.

[34]  Zeyu Sun,et al.  An Energy-Efficient Cross-Layer-Sensing Clustering Method Based on Intelligent Fog Computing in WSNs , 2019, IEEE Access.

[35]  Xiang Fu,et al.  Curvature Bag of Words Model for Shape Recognition , 2019, IEEE Access.

[36]  Yusheng Ji,et al.  A Computation-Efficient Approach for Segment Routing Traffic Engineering , 2019, IEEE Access.

[37]  Philip S. Yu,et al.  Distributed Deep Learning Model for Intelligent Video Surveillance Systems with Edge Computing , 2019, IEEE Transactions on Industrial Informatics.

[38]  Jie Tang,et al.  A Container Based Edge Offloading Framework for Autonomous Driving , 2020, IEEE Access.

[39]  Rajkumar Buyya,et al.  ARC: Anomaly-aware Robust Cloud-integrated IoT service composition based on uncertainty in advertised quality of service values , 2020, J. Syst. Softw..

[40]  Songyang Zhang,et al.  A Multipath Transport Scheme for Real-Time Multimedia Services Based on Software-Defined Networking and Segment Routing , 2020, IEEE Access.