A DEA Framework to Assess the Efficiency of the Software Requirements Capture and Analysis Process

In this paper a theoretical framework to assess the efficiency of the Requirements Capture and Analysis (RCA) process in software development is introduced. Although it is widely recognized that successful implementation of the first stages of the software development process is critical for the overall development process, RCA efficiency assessments have not been given much attention. The presented theoretical framework to assess RCA efficiency follows a production approach to model the early stages of a software project. An approach based on Data Envelopment Analysis that utilizes the proposed framework to isolate the effects of exogenous factors, such as the environment or the type of project, on the project's RCA efficiency is also presented. Finally, the applicability of the methodology through an exploratory empirical study is demonstrated, and managerial implications are discussed.

[1]  Prodromos D. Chatzoglou,et al.  Factors affecting completion of the requirements capture stage of projects with different characteristics , 1997, Inf. Softw. Technol..

[2]  John C. Henderson,et al.  Data Envelopment Analysis for Managerial Control and Diagnosis , 1989 .

[3]  Matthias Jarke,et al.  Requirements engineering in 2001: (virtually) managing a changing reality , 1994, Softw. Eng. J..

[4]  T. Osberg,et al.  The Relative Accuracy of Self-Predictions and Judgments by Others in Psychological Assessment , 1981 .

[5]  Henri Barki,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[6]  Albert S. Dexter,et al.  A Model for Measuring Information Systems Size , 1990, MIS Q..

[7]  David C. Gross,et al.  Managing Domain-Specific, Product-Line Development , 1996, IEEE Softw..

[8]  Rajiv D. Banker,et al.  Efficiency Analysis for Exogenously Fixed Inputs and Outputs , 1986, Oper. Res..

[9]  Arvind J. Thadhani.  Factors Affecting Programmer Productivity During Application Development , 1984, IBM Syst. J..

[10]  M. van Genuchten,et al.  Calibrating a software cost estimation model: why and how , 1987 .

[11]  Shaul Fox,et al.  VALIDITY OF SELF‐ASSESSMENT: A FIELD EVALUATION , 1988 .

[12]  Girish H. Subramanian,et al.  An Examination of Some Software Development Effort and Productivity Determinants in ICASE Tool Projects , 1996, J. Manag. Inf. Syst..

[13]  Joyce J. Elam,et al.  Inside a software design team: knowledge acquisition, sharing, and integration , 1993, CACM.

[14]  Chris F. Kemerer,et al.  Reliability of function points measurement: a field experiment , 2015, CACM.

[15]  D. Ross Jeffery,et al.  Function Points in the Estimation and Evaluation of the Software Process , 1990, IEEE Trans. Software Eng..

[16]  Tor Guimaraes,et al.  The Relationship Between User Participation and User Satisfaction: An Investigation of Four Contingency Factors , 1994, MIS Q..

[17]  Claude E. Walston,et al.  A Method of Programming Measurement and Estimation , 1977, IBM Syst. J..

[18]  Henri Barki,et al.  Measuring User Participation, User Involvement, and User Attitude , 1994, MIS Q..

[19]  D. J. Flynn,et al.  An empirical study of the validation process within requirements determination , 1994, Inf. Syst. J..

[20]  Suzanne Rivard,et al.  Toward an Assessment of Software Development Risk , 1993, J. Manag. Inf. Syst..

[21]  Karen J. Pettingell,et al.  Measuring Productivity of Software Projects: A Data Envelopment Analysis Approach , 1996 .

[22]  Glenn E. Littlepage.  Effects of Group Size and Task Characteristics on Group Performance: A Test of Steiner's Model , 1991 .

[23]  David N. Card,et al.  Evaluating Software Engineering Technologies , 1987, IEEE Transactions on Software Engineering.

[24]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[25]  Linda A. Macaulay,et al.  Requirements capture and IS methodologies , 1996, Inf. Syst. J..

[26]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[27]  M. Farrell.  The Measurement of Productive Efficiency , 1957 .

[28]  Rajiv D. Banker,et al.  A model to evaluate variables impacting the productivity of software maintenance projects , 1991 .

[29]  Daniel Robey,et al.  A Social Process Model of User-Analyst Relationships , 1992, MIS Q..

[30]  Rajiv D. Banker,et al.  Estimation of returns to scale using data envelopment analysis , 1992 .

[31]  William R. King,et al.  The Manager-Analyst Interface in Systems Development , 1982, MIS Q..

[32]  Emmanuel Thanassoulis,et al.  Separating Market Efficiency from Profitability and its Implications for Planning , 1995 .

[33]  J. C. Paradi,et al.  Applications of DEA to measure the efficiency of software production at two large Canadian banks , 1997, Ann. Oper. Res..

[34]  Stavros A. Zenios,et al.  Benchmarks of the Efficiency of Bank Branches , 1999, Interfaces.

[35]  Dar-Biau Liu,et al.  Metrics for requirements engineering , 1995, J. Syst. Softw..

[36]  Iris Vessey,et al.  The Effect of User Involvement on System Success: A Contingency Approach , 1988, MIS Q..

[37]  A G Rodrigues,et al.  System dynamics in software project management: towards the development of a formal integrated framework , 1997 .

[38]  D. Wilemon,et al.  A Survey of Major Approaches for Accelerating New Product Development , 1992 .

[39]  Rajiv D. Banker,et al.  Evidence on economies of scale in software development , 1994, Inf. Softw. Technol..

[40]  Earl Chrysler,et al.  Some basic determinants of computer programming productivity , 1978, CACM.

[41]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[42]  Graeme G. Shanks,et al.  User viewpoint modelling: understanding and representing user viewpoints during requirements definition , 1997, Inf. Syst. J..

[43]  James E. Hunton,et al.  Effects of the user participation process and task meaningfulness on key information system outcomes , 1997 .

[44]  Carol Withrow,et al.  Error density and size in Ada software , 1990, IEEE Software.

[45]  Cynthia Mathis Beath,et al.  The Contradictory Structure of Systems Development Methodologies: Deconstructing the IS-User Relationship in Information Engineering , 1994, Inf. Syst. Res..

[46]  Laurie J. Kirsch,et al.  Portfolios of Control Modes and IS Project Management , 1997, Inf. Syst. Res..

[47]  Ronald H. Rasch,et al.  Factors Affecting Software Developers' Performance: An Integrated Approach , 1992, MIS Q..

[48]  Michael A. Cusumano,et al.  A quantitative analysis of U.S. and Japanese practice and performance in software development , 1990 .

[49]  R. Banker.  Estimating most productive scale size using data envelopment analysis , 1984 .

[50]  Eileen M. Trauth,et al.  Critical Skills and Knowledge Requirements of IS Professionals: A Joint Academic/Industry Investigation , 1995, MIS Q..

[51]  Thomas R. Gulledge,et al.  Returns-to-Scale in Software Production: A Comparison of Approaches , 1993 .

[52]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[53]  J. Sengupta,et al.  Efficiency measurement by data envelopment analysis with econometric applications , 1988 .

[54]  Graham C. Low,et al.  Exploring Individual User Satisfaction Within User-Led Development , 1993, MIS Q..

[55]  Erran Carmel,et al.  Time-to-completion factors in packaged software development , 1995, Inf. Softw. Technol..

[56]  Rajiv D. Banker,et al.  Scale Economies in New Software Development , 2013, IEEE Transactions on Software Engineering.

[57]  Robert L. Glass,et al.  The software-research crisis , 1994, IEEE Software.

[58]  Tor Guimaraes,et al.  Successful Strategies for User Participation in Systems Development , 1997, J. Manag. Inf. Syst..

[59]  A. Griffin.  Metrics for Measuring Product Development Cycle Time , 1993 .

[60]  Robert W. Zmud,et al.  A Synthesis of Research on Requirements Analysis and Knowledge Acquisition Techniques , 1992, MIS Q..

[61]  William W. Cooper,et al.  Evaluating Program and Managerial Efficiency: An Application of Data Envelopment Analysis to Program Follow Through , 1981 .

[62]  Emmanuel Thanassoulis,et al.  Estimating preferred target input−output levels using data envelopment analysis , 1992 .