Measuring Component Performance Using A Systematic Approach and Environment

As more third-party software components are available in the commercial market, more people begin to use the component-based software engineering approach to developing component-based programs. Since most ebusiness and e-commerce application systems are net-centered distributed systems, customers usually have very restricted system performance requirements. Hence, performance testing and evaluation of software components becomes a critical task for component-based software. Although a lot of research efforts have been devoted to analysis and design methods of component-based software, only a few research papers address the issues and systematic solutions to performance testing and measurement for modern components. This paper proposes a systematic solution and environment to support performance measurement for software components. The objective is to provide a plug-in-and-measure approach to evaluate component performance, including functional speed, throughput, availability, reliability and resource utilization. It reports the development effort on constructing a distributed performance evaluation environment for software components based on a set of well-defined performance evaluation metrics and techniques. In addition, some application examples and case study results are reported.

[1]  Roger C. Cheung,et al.  A User-Oriented Software Reliability Model , 1978, IEEE Transactions on Software Engineering.

[2]  W. W. Everett,et al.  Software component reliability analysis , 1999, Proceedings 1999 IEEE Symposium on Application-Specific Systems and Software Engineering and Technology. ASSET'99 (Cat. No.PR00122).

[3]  Varsha Mainkar,et al.  Availability analysis of transaction processing systems based on user-perceived performance , 1997, Proceedings of SRDS'97: 16th IEEE Symposium on Reliable Distributed Systems.

[4]  Jeff Tian,et al.  Integrating Time Domain and Input Domain Analyses of Software Reliability Using Tree-Based Models , 1995, IEEE Trans. Software Eng..

[5]  S. V. Subrahmanya,et al.  Object driven performance testing of Web applications , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[6]  Andreas Rudolf,et al.  E-Business testing: user perceptions and performance issues , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[7]  Aditya P. Mathur,et al.  On the estimation of reliability of a software system using reliabilities of its components , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[8]  R. Boutaba,et al.  Performance evaluation for distributed system components , 1996, Proceedings of IEEE International Workshop on System Management.

[9]  Jean-Claude Laprie,et al.  Software reliability and system reliability , 1996 .

[10]  C. Murray Woodside,et al.  Evaluating the Scalability of Distributed Systems , 2000, IEEE Trans. Parallel Distributed Syst..

[11]  Ye Wu,et al.  Testing and Quality Assurance for Component-Based Software , 2003 .

[12]  Kathryn S. McKinley,et al.  Evaluating the performance of distributed architectures for information retrieval using a variety of workloads , 2000, TOIS.