Toward an XP Evaluation Framework

Software organizations are increasingly adopting the software development practices associated with the Extreme Programming (XP) methodology. Most reports on the efficacy of these practices are anecdotal. This paper provides a benchmark measurement framework for researchers and practitioners to assess concretely the extent to which an organization has adopted XP practices and the result of this adoption. We present the initial validation of our XP evaluation framework based upon a yearlong study in which an IBM team successfully adopted a subset of XP practices that was appropriate for their team culture and their project parameters. The XP practices adopted by the team enabled them to improve productivity and to achieve a two-fold improvement in the quality of new code when compared with an earlier release. The results of such case studies in various contexts are expected to constitute a body of knowledge of systematic, empirical evaluations of XP and its practices.

[1]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[2]  William L. Kleb,et al.  Exploring XP for Scientific Research , 2003, IEEE Softw..

[3]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[4]  Norman F. Schneidewind,et al.  A Methodology for Validating Software Product Metrics , 2000 .

[5]  O. Murru,et al.  Assessing XP at a European Internet Company , 2003, IEEE Softw..

[6]  Laurie A. Williams,et al.  Test-driven development as a defect-reduction practice , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[7]  Mr. Larry,et al.  Applying and Interpreting Object Oriented Metrics , 1998 .

[8]  Victor R. Basili,et al.  A validation of object oriented metrics as quality indicators , 1996 .

[9]  Ray Offen,et al.  Establishing Software Measurement Programs , 1997, IEEE Softw..

[10]  Giancarlo Succi,et al.  A Metric Suite for Evaluating the Effectiveness of an Agile Methodology , 2002 .

[11]  H. D. Rombach,et al.  THE EXPERIENCE FACTORY , 1999 .

[12]  Giancarlo Succi,et al.  Extreme Programming Examined , 2001 .

[13]  Apurva Jain,et al.  Agile Meets CMMI: Culture Clash or Common Cause? , 2002, XP/Agile Universe.

[14]  Victor R. Basili,et al.  Software process evolution at the SEL , 1994, IEEE Software.

[15]  Laurie A. Williams,et al.  Strengthening the Case for Pair Programming , 2000, IEEE Softw..

[16]  Victor R. Basili,et al.  A Validation of Object-Oriented Design Metrics as Quality Indicators , 1996, IEEE Trans. Software Eng..

[17]  Giancarlo Succi,et al.  Extreme Programming Perspectives , 2002 .

[18]  William Krebs,et al.  Turning the Knobs: A Coaching Pattern for XP through Agile Metrics , 2002, XP/Agile Universe.

[19]  Walter F. Tichy,et al.  Case study: extreme programming in a university environment , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[20]  Mark C. Paulk,et al.  Capability Maturity Model for Software , 2001 .

[21]  Mark C. Paulk,et al.  Extreme Programming from a CMM Perspective , 2001, IEEE Softw..

[22]  Charles J. Poole,et al.  Using Extreme Programming in a Maintenance Environment , 2001, IEEE Softw..

[23]  Barry W. Boehm,et al.  Using Risk to Balance Agile and Plan-Driven Methods , 2003, Computer.

[24]  Chris F. Kemerer,et al.  A Metrics Suite for Object Oriented Design , 2015, IEEE Trans. Software Eng..

[25]  Stephen H. Kan,et al.  Metrics and Models in Software Quality Engineering , 1994, SOEN.

[26]  John May,et al.  Tailoring XP for Large System Mission Critical Software Development , 2002, XP/Agile Universe.

[27]  Robert B. Grady,et al.  Practical Software Metrics for Project Management and Process Improvement , 1992 .

[28]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[29]  Susan Elliott Sim,et al.  Using benchmarking to advance research: a challenge to software engineering , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[30]  James Grenning,et al.  Launching Extreme Programming at a Process-Intensive Company , 2001, IEEE Softw..

[31]  Donald J. Reifer,et al.  How to Get the Most out of Extreme Programming/Agile Methods , 2002, XP/Agile Universe.

[32]  Mark C. Paulk,et al.  Capability Maturity Model for Software, Version 1.1 , 1993 .

[33]  Colin Potts,et al.  Software-engineering research revisited , 1993, IEEE Software.

[34]  Peter Schuh Recovery, Redemption, and Extreme Programming , 2001, IEEE Softw..

[35]  Neville Churcher,et al.  Comments on "A Metrics Suite for Object Oriented Design" , 1995, IEEE Trans. Software Eng..

[36]  Laurie Williams,et al.  Extreme Programming and Agile Methods — XP/Agile Universe 2002 , 2002, Lecture Notes in Computer Science.

[37]  Jonathan Rasmusson,et al.  Introducing XP into Greenfield Projects: Lessons Learned , 2003, IEEE Softw..

[38]  Ramanath Subramanyam,et al.  Empirical Analysis of CK Metrics for Object-Oriented Design Complexity: Implications for Software Defects , 2003, IEEE Trans. Software Eng..

[39]  Donald J. Reifer XP and the CMM , 2003, IEEE Softw..

[40]  Axel Schmolitzky,et al.  Developing Complex Projects Using XP with Extensions , 2003, Computer.

[41]  Victor R. Basili,et al.  A Methodology for Collecting Valid Software Engineering Data , 1984, IEEE Transactions on Software Engineering.