Fuzzy Allocation of Fine-Grained Compute Resources for Grid Data Streaming Applications

Fine-grained allocation of compute resources, in terms of configurable clock speed of virtual machines, is essential for processing efficiency and resource utilization of data streaming applications. For a data streaming application, its processing speed is expected to approach the allocated bandwidth as much as possible. Automatic control technology is a feasible solution, but the plant model is hard to be derived. In relation to the model free characteristic, a fuzzy logic controller is designed with several simple yet robust rules. Performance of this controller is verified to out-perform classic controllers in response rapidness and less oscillation. An empirical formula on tuning an essential parameter is obtained to achieve better performance.

[1]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[2]  Yixin Diao,et al.  Using fuzzy control to maximize profits in service level management , 2002, IBM Syst. J..

[3]  Yao-Ming Yeh,et al.  Dynamic Rightsizing with Quality-Controlled Algorithms in Virtualization Environments , 2011, Int. J. Grid High Perform. Comput..

[4]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[5]  Klara Nahrstedt,et al.  A control-based middleware framework for quality-of-service adaptations , 1999, IEEE J. Sel. Areas Commun..

[6]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..

[7]  Ian T. Foster,et al.  From sandbox to playground: dynamic virtual environments in the grid , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[8]  Kyoung-Don Kang,et al.  Adaptive Fuzzy Control for Utilization Management , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[9]  Antonio Liotta,et al.  Handbook of Research on P2P and Grid Systems for Service-oriented Computing: Models, Methodologies a , 2010 .

[10]  S. Parekh,et al.  MIMO control of an Apache web server: modeling and controller design , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[11]  Carl Kesselman,et al.  GriPhyN and LIGO, building a virtual data Grid for gravitational wave scientists , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[12]  Ekaterina Kldiashvili.  Grid Technologies for E-Health: Applications for Telemedicine Services and Delivery , 2010 .

[13]  Umakishore Ramachandran,et al.  Streamline: a scheduling heuristic for streaming applications on the grid , 2006, Electronic Imaging.

[14]  Emmanuel Udoh.  Applications and Developments in Grid, Cloud, and High Performance Computing , 2012 .

[15]  Demetris G. Galatopoullos,et al.  Service-Oriented Architectures for Pervasive Computing , 2010, Int. J. Adv. Pervasive Ubiquitous Comput..

[16]  B. Li,et al.  Grid Service Level Agreements Using Financial Risk Analysis Techniques , 2009 .

[17]  Hands-On Experience in Building Institutional Grid Infrastructure , 2009 .

[18]  Sean W. Smith,et al.  Interoperable PKI Data Distribution in Computational Grids , 2009, Int. J. Grid High Perform. Comput..

[19]  Paul Avery,et al.  The Open Science Grid , 2007 .

[20]  Andrew Warfield,et al.  Xen and the art of virtualization , 2003, SOSP '03.

[21]  Liliana Ardissono,et al.  Collaboration Support for Activity Management in a Personal Cloud Environment , 2011, Int. J. Distributed Syst. Technol..

[22]  Borja Sotomayor,et al.  Virtual Clusters for Grid Communities , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[23]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[24]  Adam Wierzbicki,et al.  Maintaining Redundancy in Peer-to-Peer Storage Systems , 2010 .

[25]  Jinjun Chen,et al.  Quantitative Quality of Service for Grid Computing: Applications for Heterogeneity, Large-scale Distribution, and Dynamic Environments , 2009 .

[26]  Oscar Deniz Suarez,et al.  Grid Architecture and Components in Diagnostic Pathology , 2011 .

[27]  Joseph L. Hellerstein,et al.  Using Control Theory to Achieve Service Level Objectives In Performance Management , 2002, Real-Time Systems.

[28]  Cheng Wu,et al.  An integrated resource management and scheduling system for grid data streaming applications , 2008, 2008 9th IEEE/ACM International Conference on Grid Computing.

[29]  Sang-Min Park,et al.  Feedback-controlled resource sharing for predictable eScience , 2008, HiPC 2008.

[30]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[31]  Ke Xu,et al.  From Enabling to Ensuring Grid Workflows , 2009 .

[32]  Yixin Diao,et al.  Feedback Control of Computing Systems , 2004 .

[33]  Erich M. Nahum,et al.  Yaksha: a self-tuning controller for managing the performance of 3-tiered Web sites , 2004, Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004..

[34]  John F. Karpovich,et al.  The Legion Resource Management System , 1999, JSSPP.

[35]  Nicholas G. Carr,et al.  The Big Switch: Rewiring the World, from Edison to Google , 2008 .

[36]  Liang Chen,et al.  A static resource allocation framework for Grid‐based streaming applications , 2006, Concurr. Comput. Pract. Exp..

[37]  Karim Faez,et al.  An Intelligent Sensor Placement Method to Reach a High Coverage in Wireless Sensor Networks , 2011, Int. J. Grid High Perform. Comput..

[38]  Renato J. O. Figueiredo,et al.  A case for grid computing on virtual machines , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[39]  Chenyang Lu,et al.  An adaptive control framework for QoS guarantees and its application to differentiated caching , 2002, IEEE 2002 Tenth IEEE International Workshop on Quality of Service (Cat. No.02EX564).