MMS-PSO for distributed regression over sensor networks

Regression is one of the effective techniques for data analysis in a WSN. Besides distributed data, the limited power supply and bandwidth capacity of nodes makes doing regression difficult in WSNs. Conventional methods, which employ some numerical optimization techniques such as Nelder-Mead simplex and gradient descent, generally work in a pre-established Hamiltonian path among the nodes. Low estimation accuracy and high latency are common shortcomings appear in these approaches. In this paper, we propose a distributed approach based on PSO, denoted as MMS-PSO (Multi Master Slave PSO), for regression analysis over sensor networks. Accordingly, after clustering the network each cluster is initially dedicated a swarm. The swarm of cluster, which sponsors learning the regressor of cluster, is equally distributed amongst the member nodes and consequently optimized through optimization of the sub-swarms (slaves). To guarantee the convergence of the cluster's swarm, some sharing points are placed between the sub-swarms via designated cluster head (master). After completion of in-cluster optimizations, each cluster head sends its regressor to the fusion center. Finally, the fusion center uses weighted averaging combination rule to combine the received regressors for constructing the final model. Our evaluation and results show that the proposed approach has quite better performance in terms of the estimation accuracy, latency and energy efficiency compared to its counterparts.

[1]  Josef Kittler,et al.  Combining multiple classifiers by averaging or by multiplying? , 2000, Pattern Recognit..

[2]  Nasrollah Moghaddam Charkari,et al.  The Effect of Re-sampling on Incremental Nelder-Mead Simplex Algorithm: Distributed Regression in Wireless Sensor Networks , 2008, WASA.

[3]  Po-Jen Chuang,et al.  An Effective PSO-Based Node Localization Scheme for Wireless Sensor Networks , 2008, 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies.

[4]  F. J. Pierce,et al.  Regional and on-farm wireless sensor networks for agricultural systems in Eastern Washington , 2008 .

[5]  Josef Kittler,et al.  Sum Versus Vote Fusion in Multiple Classifier Systems , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Luiz Eduardo Soares de Oliveira,et al.  Pairwise fusion matrix for combining classifiers , 2007, Pattern Recognit..

[7]  Qing Zhao,et al.  Distributed Learning in Wireless Sensor Networks , 2007 .

[8]  Ossama Younis,et al.  Node clustering in wireless sensor networks: recent developments and deployment challenges , 2006, IEEE Network.

[9]  Ameer Ahmed Abbasi,et al.  A survey on clustering algorithms for wireless sensor networks , 2007, Comput. Commun..

[10]  C. Guestrin,et al.  Distributed regression: an efficient framework for modeling sensor network data , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[11]  Seyyed M. T. Fatemi Ghomi,et al.  Development of a PSO-SA hybrid metaheuristic for a new comprehensive regression model to time-series forecasting , 2010, Expert Syst. Appl..

[12]  Robert P. W. Duin,et al.  The combining classifier: to train or not to train? , 2002, Object recognition supported by user interaction for service robots.

[13]  Aloor Gopakumar,et al.  Localization in wireless sensor networks using particle swarm optimization , 2008 .

[14]  Igor Kononenko,et al.  Machine Learning and Data Mining: Introduction to Principles and Algorithms , 2007 .

[15]  Zhihai He,et al.  Distributed Optimization Over Wireless Sensor Networks using Swarm Intelligence , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[16]  Mung Chiang,et al.  The value of clustering in distributed estimation for sensor networks , 2005, 2005 International Conference on Wireless Networks, Communications and Mobile Computing.

[17]  Nasrollah Moghaddam Charkari,et al.  Boosted Incremental Nelder-Mead Simplex Algorithm: Distributed Regression in Wireless Sensor Networks , 2008, MWCN/PWC.

[18]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[19]  Ganapati Panda,et al.  Particle swarm optimized multiple regression linear model for data classification , 2009, Appl. Soft Comput..

[20]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[21]  H. Vincent Poor,et al.  A Collaborative Training Algorithm for Distributed Learning , 2009, IEEE Transactions on Information Theory.