Measuring Component-Based Systems Using a Systematic Approach and Environment

SOA applications are developed to implement service-oriented workflows with service specifications. Most SOA applications are made of service-oriented components, which are built using standard specifications and interaction protocols. How to validate system performance and measure the non-function requirements and behaviors in a component-based SOA application becomes a challenge for engineer. This paper focuses on the measurement of the component-based SOA systems in terms of service-oriented process speed, system reliability, throughput, and availability. The paper proposes a systematic solution to support the system level measurement for component-based SOA software, which extends our previous component level performance measurement. The paper presents a systematic solution using an event-based functional transition model as a performance evaluation model, and its evaluation metrics, such as system processing time, throughput, availability and reliability. It reports the basic functions and design of this solution, also presents a case study and application results

[1]  Hany H. Ammar,et al.  A scenario-based reliability analysis approach for component-based software , 2004, IEEE Transactions on Reliability.

[2]  Aditya P. Mathur,et al.  Software testing and reliability , 1996 .

[3]  Swapna S. Gokhale,et al.  Reliability simulation of component-based software systems , 1998, Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257).

[4]  Terry Shepard,et al.  A component based software reliability model , 1995, CASCON.

[5]  Varsha Mainkar,et al.  Availability analysis of transaction processing systems based on user-perceived performance , 1997, Proceedings of SRDS'97: 16th IEEE Symposium on Reliable Distributed Systems.

[6]  Aniruddha S. Gokhale,et al.  A model-driven performance analysis framework for distributed, performance-sensitive software systems , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[7]  Raymond A. Paul,et al.  A software reliability model for web services , 2004, IASTED Conf. on Software Engineering and Applications.

[8]  Richard G. Hamlet,et al.  Theory of software reliability based on components , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[9]  C. Murray Woodside,et al.  Performance techniques for COTS systems , 2005, IEEE Software.

[10]  Bev Littlewood,et al.  Software reliability and dependability: a roadmap , 2000, ICSE '00.

[11]  Jerry Zeyu Gao,et al.  Measuring Component Performance Using A Systematic Approach and Environment , 2004, SOQUA/TECOS.

[12]  Ye Wu,et al.  Testing and Quality Assurance for Component-Based Software , 2003 .

[13]  Wei-Tek Tsai,et al.  Service-oriented system engineering: a new paradigm , 2005, IEEE International Workshop on Service-Oriented System Engineering (SOSE'05).

[14]  Jeffry T. Russell,et al.  Architecture-level performance evaluation of component-based embedded systems , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).