A Self-Optimization Method for System Service Dependability based on Autonomic Computing

Under the intrusion or abnormal attacks, how to supply system service dependability autonomously, without being degraded, is the essential requirement to network system service. Autonomic Computing can overcome the heterogeneity and complexity of computing system, has been regarded as a novel and effective approach to implementing autonomous systems to address system security issues. To cope with the problem of declining network service dependability caused by safety threats, we proposed an autonomic method for optimizing system service performance based on Q-learning from the perspective of autonomic computing. First, we get the operations by utilizing the nonlinear mapping relations of the feedforward neural network. Then, we obtain the executive action by perceiving the state parameter changes of the network system in the service performance. Thirdly, we calculate the environment-rewarded function value integrated the changes of the system service performance and the service availability. Finally, we use the selflearning characteristics and prediction ability of the Q-learning to make the system service to achieve optimal performance. Simulation results show that this method is effective for optimizing the overall dependability and service utility of a system.

[1]  Alan Bundy,et al.  Constructing Induction Rules for Deductive Synthesis Proofs , 2006, CLASE.

[2]  Tosiyasu L. Kunii Autonomic and Trusted Computing for Ubiquitous Intelligence , 2007, UIC.

[3]  Jeffrey Banks Embedded Diagnostics Enable Military Ground Vehicle Autonomic Logistics , 2007 .

[4]  Liu Zhen Modeling adaptive perception system of virtual human based on Q-learning , 2011 .

[5]  Alfredo Benso,et al.  A Dependable Autonomic Computing Environment for Self-Testing of Complex Heterogeneous Systems , 2005, TACoS.

[6]  Xu Wen-bo Q-learning control based on self-organizing RBF network , 2010 .

[7]  Liu Hai-tao Evolutionary Algorithm Based Reinforcement Learning in the Uncertain Environments , 2006 .

[8]  Alan D. George,et al.  Adaptable and Autonomic Mission Manager for Dependable Aerospace Computing , 2006, 2006 2nd IEEE International Symposium on Dependable, Autonomic and Secure Computing.

[9]  Yuan-Shun Dai,et al.  Modeling for NASA Autonomous Nano-Technology Swarm Missions and Model-Driven Autonomic Computing , 2007, 21st International Conference on Advanced Information Networking and Applications (AINA '07).

[10]  Priya Narasimhan,et al.  Prato: Databases on Demand , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[11]  Guo Hui A Dependable and Adaptive Approach to Supporting Web Service Composition , 2008 .

[12]  Zhen Wei-guo Optimal control method of PSS based on multi-step backtrack Q(λ) learning , 2011 .