A Comprehensive Code-Based Quality Model for Embedded Systems: Systematic Development and Validation by Industrial Projects

Existing software quality models typically focus on common quality characteristics such as the ISO 25010 software quality characteristics. However, most of them provide insufficient operationalization for quality assessments of source code. Moreover, they usually focus on software in general or on information systems and do not sufficiently cover the particularities of embedded systems. We have developed a quality model that covers quality requirements for source code that are specific for embedded systems software. It provides comprehensive operationalization (with 336 measures) for C and C++ systems, which allows for largely automated quality assessments. The empirical evaluations performed acknowledge moderate completeness of the requirements and the associated measures. Therefore, we still see room for improvements to allow covering even more aspects of embedded systems software quality. Nevertheless, the empirical validation (based on three industrial products) shows good concordance between the results gained by the automatic model-based assessment and independent expert judgment on code quality.

[1]  Markus Herrmannsdoerfer,et al.  The quamoco tool chain for quality modeling and assessment , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[2]  Silvio Romero de Lemos Meira,et al.  Quality Attributes for a Component Quality Model , 2005 .

[3]  Reinhold Plösch,et al.  The Quamoco product quality modelling and assessment approach , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[4]  Ingo Stürmer,et al.  Overview of existing safeguarding techniques for automatically generated code , 2005, ACM SIGSOFT Softw. Eng. Notes.

[5]  Jan Gerben Wijnstra,et al.  Quality Attributes and Aspects of a Medical Product Family , 2001, HICSS.

[6]  Guochun Tang,et al.  A Modification to the Jelinski-Moranda Software Reliability Growth Model Based on Cloud Model Theory , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[7]  J. E. Groves,et al.  Made in America: Science, Technology and American Modernist Poets , 1989 .

[8]  Jürgen Münch,et al.  CQML Scheme: A Classification Scheme for Comprehensive Quality Model Landscapes , 2009, 2009 35th Euromicro Conference on Software Engineering and Advanced Applications.

[9]  Shari Lawrence Pfleeger,et al.  Software Quality: The Elusive Target , 1996, IEEE Softw..

[10]  Stefan Wagner,et al.  A Bayesian network approach to assess and predict software quality using activity-based quality models , 2009, PROMISE '09.

[11]  D. L. Simms,et al.  Normal Accidents: Living with High-Risk Technologies , 1986 .

[12]  Claes Wohlin,et al.  Capture-recapture in software inspections after 10 years research--theory, evaluation and application , 2004, J. Syst. Softw..

[13]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[14]  Frank Elberzhager,et al.  Support planning and controlling of early quality assurance by combining expert judgment and defect data—a case study , 2010, Empirical Software Engineering.

[15]  Michael G. Hinchey,et al.  Model-Based Verification of Embedded Software , 2009, Computer.

[16]  Klaus Lochmann,et al.  Software Quality Models in Practice , 2012 .

[17]  Silvio Romero de Lemos Meira,et al.  Towards an Embedded Software Component Quality Verification Framework , 2009, 2009 14th IEEE International Conference on Engineering of Complex Computer Systems.

[18]  Capers Jones,et al.  Embedded Software: Facts, Figures, and Future , 2009, Computer.

[19]  Stefan Wagner,et al.  Quality models in practice: A preliminary analysis , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[20]  Paul W. Oman,et al.  Using metrics to evaluate software system maintainability , 1994, Computer.

[21]  R. Dromey,et al.  A Model for Software Product Quality , 1995, IEEE Trans. Software Eng..

[22]  Daniel L. Moody.  A Decomposition Method for Entity Relationship Models: A Systems Theoretic Approach , 2000, ICSTM.

[23]  John B. Kidd,et al.  Decisions with Multiple Objectives—Preferences and Value Tradeoffs , 1977 .

[24]  Michael R. Lyu,et al.  Software Reliability Theory , 2002 .

[25]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  K. Burnham,et al.  Estimation of the size of a closed population when capture probabilities vary among animals , 1978 .

[27]  Jürgen Münch,et al.  Model-based Product Quality Evaluation with Multi-Criteria Decision Analysis , 2014, ArXiv.

[28]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .