Estimating the CPU utilization of a rule-based system

Rule-based software systems have become very common in telecommunications settings, particularly to monitor and control workflow management of large networks. At the same time, shorter deployment cycles are frequently necessary which has led to modifications being made to the rule base, without a full assessment of the impact of these new rules through extensive performance testing.An approach is presented that helps assess the performance of rule-based systems, in terms of its CPU utilization, by using modeling and analysis. A case study is presented applying this approach to a large rule-based system that is used to monitor a very large industrial telecommunications network.

[1]  Jeng-Rung Chen,et al.  Response Time Analysis of OPS5 Production Systems , 2000, IEEE Trans. Knowl. Data Eng..

[2]  D. Berry,et al.  Statistics: Theory and Methods , 1990 .

[3]  Harold J. Steudel,et al.  A Decision-Table-Based Processor for Checking Completeness and Consistency in Rule-Based Expert Systems , 1987, Int. J. Man Mach. Stud..

[4]  Elaine J. Weyuker,et al.  The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software , 1995, IEEE Trans. Software Eng..

[5]  Walton A. Perkins,et al.  Checking an Expert Systems Knowledge Base for Consistency and Completeness , 1985, IJCAI.

[6]  James D. Kiper.  Structural testing of rule-based expert systems , 1992, TSEM.

[7]  Aloysius K. Mok,et al.  Response-Time Bounds of EQL Rule-Based Programs Under Rule Priority Structure , 1995, IEEE Trans. Software Eng..

[8]  Allen Ginsberg.  Knowledge-Base Reduction: A New Approach to Checking knowledge Bases for Inconsistency and Redundancy , 1988, AAAI.

[9]  Joseph L. Hellerstein.  An approach to selecting metrics for detecting performance problems in information systems , 1996, SIGMETRICS '96.

[10]  Tin A. Nguyen,et al.  Knowledge base verification , 1987 .

[11]  Alun D. Preece,et al.  Exploring the Structure of Rule Based Systems , 1993, AAAI.

[12]  Osman Balci,et al.  Validating Expert System Performance , 1987, IEEE Expert.

[13]  Elaine J. Weyuker,et al.  Generating test suites for software load testing , 1994, ISSTA '94.

[14]  Elaine J. Weyuker,et al.  Reliability Testing of Rule-Based Systems , 1996, IEEE Softw..

[15]  Edward H. Shortliffe,et al.  An Approach to Verifying Completeness and Consistency in a Rule-Based Expert System , 1982, AI Mag..