Diibuted componentwise EM algorithm or mixture models in sensor networks

This work considers mixture model estimation in sensor networks in a distributed manner. In the statistical literature, the maximum likelihood (ML) estimate of mixture distributions can be computed via a straightforward application of the expectation and maximization (EM) algorithm. In sensor networks without centralized processing units, data are collected and processed locally. Modifications of standard EM-type algorithms are necessary to accommodate the characteristics of sensor networks. Existing works on the distributed EM algorithm focus mainly on estimation performance and implementation aspects. Here, we address the convergence issue by proposing a distributed EM-like algorithm that updates mixture parameters sequentially. Simulation results show that the proposed approach leads to significant gain in convergence speed and considerable saving in computational time.

[1]  Xiao-Li Meng,et al.  The EM Algorithm—an Old Folk‐song Sung to a Fast New Tune , 1997 .

[2]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[3]  Robert D. Nowak,et al.  Distributed EM algorithms for density estimation and clustering in sensor networks , 2003, IEEE Trans. Signal Process..

[4]  F. J. Anscombe,et al.  Topics in the Investigation of Linear Relations Fitted by the Method of Least Squares , 1967 .

[5]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[6]  Dan Klein,et al.  Fully distributed EM for very large datasets , 2008, ICML '08.

[7]  Pramod K. Varshney,et al.  Distributed Detection and Data Fusion , 1996 .

[8]  Gilles Celeux,et al.  A Component-Wise EM Algorithm for Mixtures , 2001, 1201.5913.

[9]  Dongbing Gu,et al.  Distributed EM Algorithm for Gaussian Mixtures in Sensor Networks , 2008, IEEE Transactions on Neural Networks.

[10]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[11]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[12]  Alfred O. Hero,et al.  Space-alternating generalized expectation-maximization algorithm , 1994, IEEE Trans. Signal Process..

[13]  Satish Kumar,et al.  Next century challenges: scalable coordination in sensor networks , 1999, MobiCom.

[14]  Panganamala Ramana Kumar,et al.  RHEINISCH-WESTFÄLISCHE TECHNISCHE HOCHSCHULE AACHEN , 2001 .

[15]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.