Robust Distributed Dictionary Learning for In-Network Image Compression

Camera networks are resource-constrained distributed systems that communicate over (wireless) networks to make decisions collaboratively. For surveillance applications, these camera nodes take decisions about an object of interest within incoming videos by coordinating with neighboring nodes, which is a costly process in terms of both time and energy. Datacompression methods can bring significant energy savings in camera nodes while transmitting or storing data in the network. Signal representation using sparse approximations and overcomplete dictionaries have received considerable attention in recent years and have been shown to outperform traditional compression methods. However, distributed dictionary learning itself relies on consensus-building algorithms, which involve communicating with neighboring nodes until convergence is achieved. To this end, we design a novel protocol to enable energy-efficient and robust dictionary learning in distributed camera networks by leveraging the spatial correlation of collected multimedia data. We employ low-computational-complexity metrics to quantify the correlation across cameras nodes. We also present a feasibility study of the parameters of the network that impact the performance of distributed dictionary learning and consensus process in terms of accuracy of the algorithm and energy consumed by the camera nodes. The performance of the proposed approach is validated through extensive simulations using a network simulator and public datasets as well as via real-world experiments on a testbed of Raspberry Pi nodes.

[1]  Alexandros G. Dimakis,et al.  Geographic Gossip: Efficient Averaging for Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[2]  C.-C. Jay Kuo,et al.  Efficient dictionary based video coding with reduced side information , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[3]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[4]  Ian F. Akyildiz,et al.  A Spatial Correlation Model for Visual Information in Wireless Multimedia Sensor Networks , 2009, IEEE Transactions on Multimedia.

[5]  Junli Liang,et al.  Distributed Dictionary Learning for Sparse Representation in Sensor Networks , 2014, IEEE Transactions on Image Processing.

[6]  Bernhard Rinner,et al.  Online learning of timeout policies for dynamic power management , 2014, ACM Trans. Embed. Comput. Syst..

[7]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[8]  Teerawat Issariyakul,et al.  Introduction to Network Simulator NS2 , 2008 .

[9]  Chonho Lee,et al.  A survey of mobile cloud computing: architecture, applications, and approaches , 2013, Wirel. Commun. Mob. Comput..

[10]  Sung-Hyuk Cha,et al.  On measuring the distance between histograms , 2002, Pattern Recognit..

[11]  RinnerBernhard,et al.  Autonomous multicamera tracking on embedded smart cameras , 2007 .

[12]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[13]  Xin Yao,et al.  Socio-economic vision graph generation and handover in distributed smart camera networks , 2014, TOSN.

[14]  Ellen W. Zegura,et al.  Serendipity: enabling remote computing among intermittently connected mobile devices , 2012, MobiHoc '12.

[15]  Karim Habak,et al.  COSMOS: computation offloading as a service for mobile devices , 2014, MobiHoc '14.

[16]  Alan Messer,et al.  Towards a distributed platform for resource-constrained devices , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[17]  Zhaolin Cheng,et al.  Calibrating Distributed Camera Networks , 2008, Proceedings of the IEEE.

[18]  Amit K. Roy-Chowdhury,et al.  A Generalized Kalman Consensus Filter for wide-area video networks , 2011, IEEE Conference on Decision and Control and European Control Conference.

[19]  Kjersti Engan,et al.  Image compression using learned dictionaries by RLS-DLA and compared with K-SVD , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[22]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[23]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[24]  Lu Fang,et al.  REPC: Reliable and efficient participatory computing for mobile devices , 2014, 2014 Eleventh Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[25]  Bernhard Rinner,et al.  Autonomous Multicamera Tracking on Embedded Smart Cameras , 2007, EURASIP J. Embed. Syst..

[26]  Waheed Uz Zaman Bajwa,et al.  Dictionary learning based nonlinear classifier training from distributed data , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[27]  Bernhard Rinner,et al.  An Introduction to Distributed Smart Cameras , 2008, Proceedings of the IEEE.

[28]  I. Horev,et al.  Adaptive image compression using sparse dictionaries , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[29]  Waheed Uz Zaman Bajwa,et al.  Cloud K-SVD: A Collaborative Dictionary Learning Algorithm for Big, Distributed Data , 2014, IEEE Transactions on Signal Processing.