MESO: Supporting Online Decision Making in Autonomic Computing Systems

Autonomic computing systems must be able to detect and respond to errant behavior or changing conditions with little or no human intervention. Clearly, decision making is a critical issue in such systems, which must learn how and when to invoke corrective actions based on past experience. This paper describes the design, implementation, and evaluation of MESO, a pattern classifier designed to support online, incremental learning and decision making in autonomic systems. A novel feature of MESO is its use of small agglomerative clusters, called sensitivity spheres, that aggregate similar training samples. Sensitivity spheres are partitioned into sets during the construction of a memory-efficient hierarchical data structure. This structure facilitates data compression, which is important to many autonomic systems. Results are presented demonstrating that MESO achieves high accuracy while enabling rapid incremental training and classification. A case study is described in which MESO enables a mobile computing application to learn, by imitation, user preferences for balancing wireless network packet loss and bandwidth consumption. Once trained, the application can autonomously adjust error control parameters as needed while the user roams about a wireless cell

[1]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[2]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[3]  Jiawei Han,et al.  Classifying large data sets using SVMs with hierarchical clusters , 2003, KDD '03.

[4]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[5]  Jane S. Paulsen.  Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate , 1996 .

[6]  Seyed Masoud Sadjadi,et al.  On quality-of-service and energy consumption tradeoffs in FEC-encoded audio streaming , 2004, Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004..

[7]  Simon Kasif,et al.  A System for Induction of Oblique Decision Trees , 1994, J. Artif. Intell. Res..

[8]  Denis J. Dean,et al.  Comparative accuracies of artificial neural networks and discriminant analysis in predicting forest cover types from cartographic variables , 1999 .

[9]  Tony Jebara,et al.  Statistical imitative learning from perceptual data , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[10]  Hans-Peter Kriegel,et al.  Data bubbles: quality preserving performance boosting for hierarchical clustering , 2001, SIGMOD '01.

[11]  Philip K. McKinley,et al.  A Study of Adaptive Forward Error Correction for Wireless Collaborative Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[12]  Alexander J. Smola,et al.  Online learning with kernels , 2001, IEEE Transactions on Signal Processing.

[13]  Mineichi Kudo,et al.  Multidimensional curve classification using passing-through regions , 1999, Pattern Recognit. Lett..

[14]  Koby Crammer,et al.  Online Classification on a Budget , 2003, NIPS.

[15]  Pavel Zezula,et al.  M-tree: An Efficient Access Method for Similarity Search in Metric Spaces , 1997, VLDB.

[16]  Seyed Masoud Sadjadi,et al.  Architecture and operation of an adaptable communication substrate , 2003, The Ninth IEEE Workshop on Future Trends of Distributed Computing Systems, 2003. FTDCS 2003. Proceedings..

[17]  Alejandro Murua,et al.  Assessment and pruning of hierarchical model based clustering , 2003, KDD '03.

[18]  A. J. McAuley.  Reliable broadband communication using a burst erasure correcting code , 1990, SIGCOMM 1990.

[19]  Robert L. Grossman,et al.  GenIc: A Single-Pass Generalized Incremental Algorithm for Clustering , 2004, SDM.

[20]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  P. K. McKinley,et al.  MESO : Perceptual Memory to Support Online Learning in Adaptive Software ∗ , 2004 .

[22]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[23]  R. Amit,et al.  Learning movement sequences from demonstration , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[24]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[25]  Seyed Masoud Sadjadi,et al.  Composing adaptive software , 2004, Computer.

[26]  Y. A. Ivanov,et al.  Developmental learning of memory-based perceptual models , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[27]  Wray L. Buntine.  Decision tree induction systems: A Bayesian analysis , 1987, Int. J. Approx. Reason..

[28]  Stan Franklin.  Perceptual Memory and Learning : Recognizing , Categorizing , and Relating , 2005 .

[29]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[30]  J. C. Schlimmer,et al.  Concept acquisition through representational adjustment , 1987 .

[31]  Robert P. W. Duin,et al.  Handwritten digit recognition by combined classifiers , 1998, Kybernetika.

[32]  Luigi Rizzo,et al.  Effective erasure codes for reliable computer communication protocols , 1997, CCRV.

[33]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[34]  Eric A. Brewer,et al.  Pinpoint: problem determination in large, dynamic Internet services , 2002, Proceedings International Conference on Dependable Systems and Networks.

[35]  Tian Zhang,et al.  BIRCH: an efficient data clustering method for very large databases , 1996, SIGMOD '96.

[36]  Seyed Masoud Sadjadi,et al.  Composable Proxy Services to Support Collaboration on the Mobile Internet , 2003, IEEE Trans. Computers.

[37]  Pierre Geurts,et al.  A machine learning approach to improve congestion control over wireless computer networks , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[38]  Wray Buntine.  Tree Classification Software , 1993 .

[39]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[40]  Sreerama K. Murthy,et al.  Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey , 1998, Data Mining and Knowledge Discovery.

[41]  Philip S. Yu,et al.  Fast algorithms for projected clustering , 1999, SIGMOD '99.

[42]  Alejandro Murua,et al.  Hierarchical model-based clustering of large datasets through fractionation and refractionation , 2002, Inf. Syst..

[43]  David J. Slate,et al.  Letter Recognition Using Holland-Style Adaptive Classifiers , 1991, Machine Learning.

[44]  Pat Langley,et al.  Generalized clustering, supervised learning, and data assignment , 2001, KDD '01.

[45]  Philip K. McKinley,et al.  LEADER-DRIVEN MULTICAST FOR VIDEO STREAMING ON WIRELESS LANS , 2002 .

[46]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[47]  Juyang Weng,et al.  Hierarchical Discriminant Regression , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[49]  Juyang Weng,et al.  An Incremental Learning Algorithm with Automatically Derived Discriminating Features , 2000 .

[50]  Joydeep Ghosh,et al.  Hierarchical Fusion of Multiple Classifiers for Hyperspectral Data Analysis , 2002, Pattern Analysis & Applications.