A Unified Benchmarking Process for Components in Automotive Embedded Systems Software

During the last years, component based software development has become a well accepted software engineering paradigm within the automotive industry. This fact is not only reflected by upcoming development tools but also by newly arising automotive software standards. In component based software engineering, applications are built by assembling small reusable building blocks, the components. Typically more than one component implementation meets the application developer's requirements, so proper selection of the assembled components becomes a key element of the whole procurement and engineering process. This paper's contribution is twofold: First, a basic set of performance and dependability metrics and measures for automotive components is identified. Second, a unified benchmarking process is proposed, that allows an unambiguous comparison of distinct component implementations of a given component class.

[1]  Octavian Paul Rotaru,et al.  Reusability metrics for software components , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..

[2]  Kenneth N. Meyer,et al.  Evaluating COTS component dependability in context , 2005, IEEE Software.

[3]  Yves Crouzet,et al.  Towards a Framework for Dependability Benchmarking , 2002 .

[4]  Karl M. Göschka,et al.  Explicit Connectors in Component Based Software Engineering for Distributed Embedded Systems , 2007, SOFSEM.

[5]  Philip Koopman,et al.  Dependability Benchmarking: making choices in an n-dimensional problem space , 2001 .

[6]  Toby J. Teorey,et al.  Dependability and Performance Measures for the Database Practitioner , 1998, IEEE Trans. Knowl. Data Eng..

[7]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[8]  Ji Zhu,et al.  R-cubed (R 3 ): rate, robustness, and recovery - an availability benchmark framework , 2002 .

[9]  Brendan Murphy,et al.  Progress on Defining Standardized Classes for Comparing the Dependability of Computer Systems , 2002 .

[10]  Mario Dal Cin,et al.  Reproducible dependability benchmarking experiments based on unambiguous benchmark setup descriptions , 2003, 2003 International Conference on Dependable Systems and Networks, 2003. Proceedings..

[11]  Soo Dong Kim,et al.  Component metrics to measure component quality , 2001, Proceedings Eighth Asia-Pacific Software Engineering Conference.

[12]  Shari Lawrence Pfleeger,et al.  Software metrics - a practical and rigorous approach (2. ed.) , 1996 .

[13]  Antonio Vallecillo,et al.  Quality Attributes for COTS Components , 2002 .

[14]  Raimund Kirner,et al.  Measurement-based worst-case execution time analysis , 2005, Third IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems (SEUS'05).

[15]  Arvinder Kaur,et al.  Component Based Software Engineering , 2010 .

[16]  Jean Arlat,et al.  A Framework for Dependability Benchmarking , 2002 .

[17]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.