Test software quality issues and connections to international standards

Abstract This paper examines how ISO/IEC 9126-1 and ISO/IEC 25010 quality models can be applied to software testing products in industrial environment. We present a set of code smells for test systems written in TTCN-3 and their categorization according to quality model standards. We demonstrate our measurements on industrial and ETSI projects, and provide a method for estimating their effects on product risks in current projects.

[1]  Jens Grabowski,et al.  An approach to quality engineering of TTCN-3 test specifications , 2008, International Journal on Software Tools for Technology Transfer.

[2]  Tracy Hall,et al.  Code Bad Smells: a review of current knowledge , 2011, J. Softw. Maintenance Res. Pract..

[3]  Jorawar Singh,et al.  TSP (Team Software Process) , 2013 .

[4]  Egon Berghout,et al.  The Goal/Question/Metric method: a practical guide for quality improvement of software development , 1999 .

[5]  Tsutomu Ishida,et al.  Metrics and Models in Software Quality Engineering , 1995 .

[6]  Ina Schieferdecker,et al.  Applying the ISO 9126 quality model to test specifications - exemplified for TTCN-3 test specifications , 2007, Software Engineering.

[7]  Helmut Neukirchen,et al.  Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites , 2007, TestCom/FATES.

[8]  Raed Shatnawi,et al.  An empirical study of the bad smells and class error probability in the post-release object-oriented system evolution , 2007, J. Syst. Softw..

[9]  Akito Monden,et al.  Software quality analysis by code clones in industrial legacy software , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[10]  Don Roberts,et al.  Refactoring , 2015, IEEE Softw..

[11]  Anna Rita Fasolino,et al.  Lo Standard ISO/IEC 9126 – Software engineering – Product Quality , 2010 .

[12]  Etsi Standard,et al.  Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language Extensions: Support of interfaces with continuous signals , 2014 .

[13]  李幼升,et al.  Ph , 1989 .

[14]  Kristóf Szabados,et al.  Structural Analysis of Large TTCN-3 Projects , 2009, TestCom/FATES.

[15]  Martin Fowler,et al.  Refactoring - Improving the Design of Existing Code , 1999, Addison Wesley object technology series.

[16]  Gerard Meszaros,et al.  xUnit Test Patterns: Refactoring Test Code , 2007 .

[17]  Foutse Khomh,et al.  An Exploratory Study of the Impact of Code Smells on Software Change-proneness , 2009, 2009 16th Working Conference on Reverse Engineering.

[18]  Jens Grabowski,et al.  Calculation and optimization of thresholds for sets of software metrics , 2011, Empirical Software Engineering.

[19]  Vesselin Spiridonov.  Understanding and Controlling Software Costs - Response , 1986, IFIP Congress.

[20]  Antal Tátrai,et al.  SOURCE CODE SCANNERS IN SOFTWARE QUALITY MANAGEMENT AND CONNECTIONS TO INTERNATIONAL STANDARDS , 2012 .