论文信息 - Agent selection for regression on attribute distributed data

Agent selection for regression on attribute distributed data

This paper introduces a modeling framework for multivariate regression with agents observing attribute-distributed data, coordinated by a fusion center. Under this model, a prototype algorithm resembling the L2 boosting algorithm can effectively minimize the training error, yet it suffers from over-training and slow convergence. A thorough comparison among the agents can speed up convergence of training error and eliminate irrelevant variables, yet it imposes a high demand for data transmission. In this paper, an intelligent agent selection algorithm (based on heuristic functions) is proposed to speed up convergence at low cost of data transmission. The new algorithm can achieve an ensemble estimator of better generalization error with less communication, which is verified by simulation on artificial and real data sets.

H. Vincent Poor | Sanjeev R. Kulkarni | Haipeng Zheng

[1] Philip K. Chan,et al. Advances in Distributed and Parallel Knowledge Discovery , 2000 .

[2] H. Vincent Poor,et al. Dimensionally distributed learning models and algorithm , 2008, 2008 11th International Conference on Information Fusion.

[3] Daryl E. Hershberger,et al. Collective Data Mining: a New Perspective toward Distributed Data Mining Advances in Distributed Data Mining Book , 1999 .

[4] J. Friedman,et al. Multidimensional Additive Spline Approximation , 1983 .

[5] Joydeep Ghosh,et al. A distributed learning framework for heterogeneous data sources , 2005, KDD '05.

[6] Hillol Kargupta,et al. Distributed Multivariate Regression Using Wavelet-Based Collective Data Mining , 2001, J. Parallel Distributed Comput..

[7] David B. Skillicorn,et al. Building predictors from vertically distributed data , 2004, CASCON.

[8] Salvatore J. Stolfo,et al. Toward parallel and distributed learning by meta-learning , 1993 .