Software Measurement Activities in Small and Medium Enterprises: an Empirical Assessment

An empirical study for evaluating the proper implementation of measurement/metric programs in software companies in one area of Turkey is presented. The research questions are discussed and validated with the help of senior software managers (more than 15 years' experience) and then used for interviewing a variety of medium and small scale software companies in Ankara. Observations show that there is a common reluctance/lack of interest in utilizing measurements/metrics despite the fact that they are well known in the industry. A side product of this research is that internationally recognized standards such as ISO and CMMI are pursued if they are a part of project/job requirements; without these requirements, introducing those standards to the companies remains as a long-term target to increase quality.

[1]  Patrik Berander,et al.  A goal question metric based approach for efficient measurement framework definition , 2006, ISESE '06.

[2]  E George,et al.  Measurements to Manage Software Maintenance , 1997 .

[3]  Lorin M. Hitt,et al.  Beyond the productivity paradox , 1998, CACM.

[4]  Audris Mockus,et al.  Does Code Decay? Assessing the Evidence from Change Management Data , 2001, IEEE Trans. Software Eng..

[5]  E. W. Olsen,et al.  Software Process Improvement: Metrics, Measurement, and Process Modelling , 2001, Springer Berlin Heidelberg.

[6]  Cem Kaner,et al.  Software Engineering Metrics: What Do They Measure and How Do We Know? , 2004 .

[7]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[8]  Lorin M. Hitt,et al.  Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value , 1996, MIS Q..

[9]  Nasib S. Gill,et al.  Dependency and interaction oriented complexity metrics of component-based systems , 2008, SOEN.

[10]  Shiyi Xu,et al.  An Accurate Model of Software Reliability , 2007, 13th Pacific Rim International Symposium on Dependable Computing (PRDC 2007).

[11]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach , 1982 .

[12]  Yingxu Wang.  The measurement theory for software engineering , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[13]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[14]  Hans van Vliet,et al.  Software engineering - principles and practice (3. ed.) , 2008 .

[15]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[16]  Norman E. Fenton,et al.  Measurement : A Necessary Scientific Basis , 2004 .

[17]  Alain Abran,et al.  Lack of Consensus on Measurement in Software Engineering: Investigation of Related Issues , 2004 .

[18]  Hans van Vliet,et al.  Software engineering - principles and practice , 1993 .

[19]  Lorin M. Hitt,et al.  Economic analysis of information technology and organization , 1996 .

[20]  Sanjay Misra,et al.  Measurement theory and validation criteria for software complexity measures , 2006, SOEN.

[21]  Sandeep Purao,et al.  Product metrics for object-oriented systems , 2003, CSUR.

[22]  Serge Demeyer,et al.  The FAMOOS Object-Oriented Reengineering Handbook , 1999 .

[23]  Shunji Osaki,et al.  Software reliability measurement and assessment methods during operation phase and their comparisons , 1992, Systems and Computers in Japan.

[24]  Xuejun Yang,et al.  Effective runtime scalability metric to measure productivity in high performance computing systems , 2008, CF '08.

[25]  Maurice H. Halstead,et al.  Elements of software science (Operating and programming systems series) , 1977 .

[26]  András Keszthelyi.  Remarks on the Efficiency of Information Systems , 2011 .

[27]  J. D. Musa.  The use of software reliability measures in project management , 1978, COMPSAC.

[28]  Mario Piattini,et al.  A systematic review measurement in software engineering: State-of-the-art in Measures , 2006, ICSOFT.

[29]  Ville Leppänen,et al.  A software metric for coherence of class roles in Java programs , 2007, PPPJ.

[30]  Kishor S. Trivedi,et al.  An approach for estimation of software aging in a Web server , 2002, Proceedings International Symposium on Empirical Software Engineering.

[31]  Richard Scudder,et al.  Productivity measures for information systems , 1991, Inf. Manag..

[32]  David Lorge Parnas,et al.  Software aging , 1994, Proceedings of 16th International Conference on Software Engineering.

[33]  Rüdiger Lincke,et al.  Comparing software metrics tools , 2008, ISSTA '08.

[34]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach (McGraw-Hill Series in Computer Science) , 2004 .

[35]  Sajjad Mahmood,et al.  A complexity measure for UML component-based system specification , 2008 .

[36]  Kishor S. Trivedi,et al.  A methodology for detection and estimation of software aging , 1998, Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257).

[37]  Sandro Morasca,et al.  Foundations of a Weak Measurement-Theoretic Approach to Software Measurement , 2003, FASE.

[38]  Horst Zuse,et al.  A Framework of Software Measurement , 1998 .