Distributed Adaptive Clustering Based on Maximum Correntropy Criterion Over Dynamic Multi-Task Networks

This paper focuses on the problem of distributed adaptive estimation over dynamic multi-task networks, where a set of nodes is required to collectively estimate some parameters of interest from noisy measurements. Besides, since nodes in the network are constrained by communication power consumption and external interference in a non-stationary environment, the objective pursued by the node is prone to change or abnormality. The problem is worth considering in several contexts including multi-target tracking, multi-model classification and heterogeneous network segmentation. We propose a distributed adaptive clustering strategy, which is mainly composed of two procedures: normal task adaptation and the same task cluster. The task anomaly detection based on non-cooperative least-mean-squares (NC-LMS) algorithm and task switching detection based on diffusion maximum correntropy criterion (D-MCC) algorithm are provided. A series of scenarios, such as dynamic network, time-varying tasks and non-stationary (Gaussian and pulse interference) are simulated. We also discuss optimization schemes to design the NC-LMS and D-MCC weights and examine the estimate performance and clustering effects of the proposed algorithm by simulation results.

[1]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[2]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[3]  Zhaoyang Zhang,et al.  Distributed estimation over complex networks , 2012, Inf. Sci..

[4]  José Carlos Príncipe,et al.  Diffusion least-mean squares over adaptive networks with dynamic topologies , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[5]  Yunqian Ma,et al.  Multiple model regression estimation , 2005, IEEE Transactions on Neural Networks.

[6]  H. Crichton-Miller Adaptation , 1926 .

[7]  Nanning Zheng,et al.  Minimum Error Entropy Kalman Filter , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[9]  H.C. Papadopoulos,et al.  Locally constructed algorithms for distributed computations in ad-hoc networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[10]  Ali H. Sayed,et al.  Distributed Decision-Making Over Adaptive Networks , 2013, IEEE Transactions on Signal Processing.

[11]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[12]  Badong Chen,et al.  Maximum Correntropy Estimation Is a Smoothed MAP Estimation , 2012, IEEE Signal Processing Letters.

[13]  Jie Chen,et al.  Diffusion LMS Over Multitask Networks , 2014, IEEE Transactions on Signal Processing.

[14]  Ali H. Sayed,et al.  Sparse diffusion LMS for distributed adaptive estimation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Badong Chen,et al.  Kernel Kalman Filtering With Conditional Embedding and Maximum Correntropy Criterion , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[16]  Nanning Zheng,et al.  Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering , 2016, IEEE Transactions on Signal Processing.

[17]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[18]  J. Liu,et al.  Multitarget Tracking in Distributed Sensor Networks , 2007, IEEE Signal Processing Magazine.

[19]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[20]  Ali H. Sayed,et al.  Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[21]  Robert D. Nowak,et al.  Quantized incremental algorithms for distributed optimization , 2005, IEEE Journal on Selected Areas in Communications.

[22]  Xiaodan Shao,et al.  Broken-motifs diffusion LMS algorithm for reducing communication load , 2017, Signal Process..

[23]  Jie Chen,et al.  Multitask Diffusion Adaptation Over Networks , 2013, IEEE Transactions on Signal Processing.

[24]  D. Bertsekas,et al.  Incremental subgradient methods for nondifferentiable optimization , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[25]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[26]  Qiang He,et al.  Performance-Aware Cost-Effective Resource Provisioning for Future Grid IoT-Cloud System , 2019, Journal of Energy Engineering.

[27]  Thakshila Wimalajeewa,et al.  Distributed Node Selection for Sequential Estimation over Noisy Communication Channels , 2010, IEEE Transactions on Wireless Communications.

[28]  Jean-Philippe Vert,et al.  Clustered Multi-Task Learning: A Convex Formulation , 2008, NIPS.

[29]  Xi Zhang,et al.  Adaptive Control and Reconfiguration of Mobile Wireless Sensor Networks for Dynamic Multi-Target Tracking , 2011, IEEE Transactions on Automatic Control.

[30]  Xinyu Li,et al.  A Robust Diffusion Minimum Kernel Risk-Sensitive Loss Algorithm over Multitask Sensor Networks , 2019, Sensors.

[31]  Ali H. Sayed,et al.  Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior , 2013, IEEE Signal Processing Magazine.

[32]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[33]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[34]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[35]  Ivor Francis,et al.  Classification and Estimation of Several Multiple Regressions , 1974 .

[36]  Hang Liu,et al.  Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning , 2019, IEEE Access.

[37]  Jiandong Duan,et al.  Diffusion maximum correntropy criterion algorithms for robust distributed estimation , 2015, Digit. Signal Process..

[38]  Shukai Duan,et al.  Diffusion generalized maximum correntropy criterion algorithm for distributed estimation over multitask network , 2018, Digit. Signal Process..

[39]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[40]  Ali H. Sayed,et al.  Diffusion adaptive networks with changing topologies , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[41]  Badong Chen,et al.  System Parameter Identification: Information Criteria and Algorithms , 2013 .

[42]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[43]  Ali H. Sayed,et al.  Clustering via diffusion adaptation over networks , 2012, 2012 3rd International Workshop on Cognitive Information Processing (CIP).

[44]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[45]  Y. Bar-Shalom,et al.  Multiple-model estimation with variable structure , 1996, IEEE Trans. Autom. Control..

[46]  Ali H. Sayed,et al.  Distributed Clustering and Learning Over Networks , 2014, IEEE Transactions on Signal Processing.