A DEA–Tobit Analysis to Understand the Role of Experience and Task Factors in the Efficiency of Software Engineers

This study employs the data-envelopment analysis (DEA)-Tobit regression approach to analyze data from a leading software engineering organization to gain insights regarding the role of various types of technical experience and task factors in the efficiency of personnel assigned to software tasks. “Efficiency” follows a holistic-view definition as the quality and productivity achieved from the overall personnel experience, and it is evaluated with DEA. Then, a Tobit regression model is employed to determine the effect that various types of technical experience and task factors have on the DEA efficiency scores. Although the DEA-Tobit technique has been applied to various areas within the management science and operations research fields, it has not yet been presented as a general evaluation tool within the software-engineering field to understand drivers of software quality and productivity. We demonstrate how DEA-Tobit fills a gap not addressed by commonly applied methods in the literature.

[1]  L. Sproull,et al.  Coordinating Expertise in Software Development Teams , 2000 .

[2]  Richard Hader.  Tightening the belt in 2009. , 2009, Nursing management.

[3]  Herbert Moskowitz,et al.  Human resource selection for software development projects using Taguchi's parameter design , 2003, Eur. J. Oper. Res..

[4]  Mayuram S. Krishnan,et al.  The role of team factors in software cost and quality: An empirical analysis , 1998, Inf. Technol. People.

[5]  Edgar Erdfelder,et al.  GPOWER: A general power analysis program , 1996 .

[6]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[7]  Amrit Tiwana,et al.  An empirical study of the effect of knowledge integration on software development performance , 2004, Inf. Softw. Technol..

[8]  Sandra Slaughter,et al.  Quality Improvement and Infrastructure Activity Costs in Software Development: A Longitudinal Analysis , 2003, Manag. Sci..

[9]  Manuela Pulina,et al.  An investigation into the relationship between size and efficiency of the Italian hospitality sector: A window DEA approach , 2010, Eur. J. Oper. Res..

[10]  Ayoe Hoff,et al.  Second stage DEA: Comparison of approaches for modelling the DEA score , 2007, Eur. J. Oper. Res..

[11]  Ning Nan,et al.  THE IMPACT OF SCHEDULE PRESSURE ON SOFTWARE DEVELOPMENT: A BEHAVIORAL PERSPECTIVE , 2003 .

[12]  Howard B. Lee,et al.  A First Course in Factor Analysis 2nd Ed , 1973 .

[13]  Rajiv D. Banker,et al.  A model to evaluate variables impacting the productivity of software maintenance projects , 1991 .

[14]  Cheryl Andrew,et al.  Defense Acquisitions: Stronger Management Practices are Needed to Improve DOD's Software-Intensive Weapon Acquisitions , 2004 .

[15]  Sean Pascoe,et al.  Factors affecting technical efficiency in fisheries: stochastic production frontier versus data envelopment analysis approaches , 2005 .

[16]  Tarek K. Abdel-Hamid,et al.  The Dynamics of Software Project Staffing: A System Dynamics Based Simulation Approach , 1989, IEEE Trans. Software Eng..

[17]  Natalia Juristo Juzgado,et al.  Emphasizing human capabilities in software development , 2006, IEEE Software.

[18]  Norman E. Fenton,et al.  Quantitative Analysis of Faults and Failures in a Complex Software System , 2000, IEEE Trans. Software Eng..

[19]  Carlos E. Otero,et al.  A systematic approach for resource allocation in software projects , 2009, Comput. Ind. Eng..

[20]  W. B. Liu,et al.  DEA models with undesirable inputs and outputs , 2010, Ann. Oper. Res..

[21]  The Effects of Health Insurance on Female Labor Supply by Income Class , 2006 .

[22]  Jennifer A. Farris,et al.  Evaluating the Relative Performance of Engineering Design Projects: A Case Study Using Data Envelopment Analysis , 2006, IEEE Transactions on Engineering Management.

[23]  He-Yau Kang,et al.  A DEA window analysis on the product family mix selection for a semiconductor fabricator , 2008, Expert Syst. Appl..

[24]  Manish Agrawal,et al.  Software Effort, Quality, and Cycle Time: A Study of CMM Level 5 Projects , 2007, IEEE Transactions on Software Engineering.

[25]  Franz Lehner,et al.  Requirements Engineering as a Success Factor in Software Projects , 2001, IEEE Softw..

[26]  Barry W. Boehm,et al.  Disaggregating and Calibrating the CASE Tool Variable in COCOMO II , 2002, IEEE Trans. Software Eng..

[27]  Prodromos D. Chatzoglou,et al.  Factors affecting completion of the requirements capture stage of projects with different characteristics , 1997, Inf. Softw. Technol..

[28]  Mayuram S. Krishnan,et al.  Measuring Process Consistency: Implications for Reducing Software Defects , 1999, IEEE Trans. Software Eng..

[29]  Michael Diaz,et al.  How Software Process Improvement Helped Motorola , 1997, IEEE Softw..

[30]  William W. Cooper,et al.  Introduction to Data Envelopment Analysis and Its Uses: With Dea-Solver Software and References , 2005 .

[31]  John E. Gaffney,et al.  Estimating the Number of Faults in Code , 1984, IEEE Transactions on Software Engineering.

[32]  V. Skirbekk,et al.  Age and Individual Productivity: A Literature Survey , 2003 .

[33]  Rob J. Kusters,et al.  Identification of factors that influence defect injection and detection in development of software intensive products , 2007, Inf. Softw. Technol..

[34]  M. S. Krishnan,et al.  An Empirical Analysis of Productivity and Quality in Software Products , 2000 .

[35]  Khaled El Emam,et al.  A field study of requirements engineering practices in information systems development , 1995, Proceedings of 1995 IEEE International Symposium on Requirements Engineering (RE'95).