Edge Computing Framework for Cooperative Video Processing in Multimedia IoT Systems

Multimedia Internet-of-Things (IoT) systems have been widely used in surveillance, automatic behavior analysis and event recognition, which integrate image processing, computer vision, and networking capabilities. In conventional multimedia IoT systems, videos captured by surveillance cameras are required to be delivered to remote IoT servers for video analysis. However, the long-distance transmission of a large volume of video chunks may cause congestions and delays due to limited network bandwidth. Nowadays, mobile devices, e.g., smart phones and tablets, are resource-abundant in computation and communication capabilities. Thus, these devices have the potential to extract features from videos for the remote IoT servers. By sending back only a few video features to the remote servers, the bandwidth starvation of delivering original video chunks can be avoided. In this paper, we propose an edge computing framework to enable cooperative processing on resource-abundant mobile devices for delay-sensitive multimedia IoT tasks. We identify that the key challenges in the proposed edge computing framework are to optimally form mobile devices into video processing groups and to dispatch video chunks to proper video processing groups. Based on the derived optimal matching theorem, we put forward a cooperative video processing scheme formed by two efficient algorithms to tackle above challenges, which achieves suboptimal performance on the human detection accuracy. The proposed scheme has been evaluated under diverse parameter settings. Extensive simulation confirms the superiority of the proposed scheme over other two baseline schemes.

[1]  Victor C. M. Leung,et al.  Energy Efficient Cooperative Computing in Mobile Wireless Sensor Networks , 2018, IEEE Transactions on Cloud Computing.

[2]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[3]  Luigi Atzori,et al.  Quality of Experience in the Multimedia Internet of Things: Definition and practical use-cases , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[4]  Thomas G. Robertazzi,et al.  Greedy Signature Processing with Arbitrary Location Distributions: A Divisible Load Framework , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[5]  Xu Chen,et al.  Social-Aware Video Multicast Based on Device-to-Device Communications , 2016, IEEE Transactions on Mobile Computing.

[6]  Vijay Janapa Reddi,et al.  Mobile CPU's rise to power: Quantifying the impact of generational mobile CPU design trends on performance, energy, and user satisfaction , 2016, 2016 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[7]  Tao Jiang,et al.  Share communication and computation resources on mobile devices: a social awareness perspective , 2016, IEEE Wireless Communications.

[8]  Jitender S. Deogun,et al.  An Efficient Algorithm for Real-Time Divisible Load Scheduling , 2010, 2010 16th IEEE Real-Time and Embedded Technology and Applications Symposium.

[9]  Daniel Lehmann,et al.  Combinatorial auctions with decreasing marginal utilities , 2001, EC '01.

[10]  Laureano F. Escudero,et al.  A branch-and-cut algorithm for the Winner Determination Problem , 2009, Decis. Support Syst..

[11]  Jitender S. Deogun,et al.  Real-Time Divisible Load Scheduling for Cluster Computing , 2007, 13th IEEE Real Time and Embedded Technology and Applications Symposium (RTAS'07).

[12]  György Dán,et al.  Predictive Distributed Visual Analysis for Video in Wireless Sensor Networks , 2016, IEEE Transactions on Mobile Computing.

[13]  Marco Tagliasacchi,et al.  A visual sensor network for object recognition: Testbed realization , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[14]  Yongdong Zhang,et al.  Enhancing Video Event Recognition Using Automatically Constructed Semantic-Visual Knowledge Base , 2015, IEEE Transactions on Multimedia.

[15]  Tao Jiang,et al.  A Survey of Emerging M2M Systems: Context, Task, and Objective , 2016, IEEE Internet of Things Journal.

[16]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[17]  Peter Kilpatrick,et al.  Challenges and Opportunities in Edge Computing , 2016, 2016 IEEE International Conference on Smart Cloud (SmartCloud).

[18]  Debasish Ghose,et al.  Foreword (Special Issue of Cluster Computing on Divisible Load Scheduling) , 2004, Cluster Computing.

[19]  Teruo Higashino,et al.  Edge-centric Computing: Vision and Challenges , 2015, CCRV.

[20]  Jenq-Neng Hwang,et al.  A Quality-of-Content-Based Joint Source and Channel Coding for Human Detections in a Mobile Surveillance Cloud , 2017, IEEE Transactions on Circuits and Systems for Video Technology.