CEFAM: Comprehensive Evaluation Framework for Agile Methodologies

Agile software development is regarded as an effective and efficient approach, mainly due to its ability to accommodate rapidly changing requirements, and to cope with modern software development challenges. There is therefore a strong tendency to use agile software development methodologies where applicable; however, the sheer number of existing agile methodologies and their variants hinders the selection of an appropriate agile methodology or method chunk. Methodology evaluation tools address this problem through providing detailed evaluations, yet no comprehensive evaluation framework is available for agile methodologies. We introduce the comprehensive evaluation framework for agile methodologies (CEFAM) as an evaluation tool for project managers and method engineers. The hierarchical (and mostly quantitative) evaluation criterion set introduced in this evaluation framework enhances the usability of the framework and provides results that are precise enough to be useful for the selection, adaptation and construction of agile methodologies.

[1]  Sjaak Brinkkemper,et al.  Complexity Metrics for Systems Development Methods and Techniques , 1996, Inf. Syst..

[2]  Barry W. Boehm,et al.  Using Risk to Balance Agile and Plan-Driven Methods , 2003, Computer.

[3]  Mario Piattini,et al.  A family of experiments to validate metrics for software process models , 2005, J. Syst. Softw..

[4]  Teemu Reiman,et al.  Juha Koskela Software configuration management in agile methods , 2004 .

[5]  Peter Lappo,et al.  Assessing Agility , 2004, XP.

[6]  Khanh Hoa Dam,et al.  Evaluating and Comparing Agent-Oriented Software Engineering Methodologies , 2003 .

[7]  Mohammad Alshayeb,et al.  An empirical study of system design instability metric and design evolution in an agile software process , 2005, J. Syst. Softw..

[8]  Minna Pikkarainen,et al.  An Approach for Assessing Suitability of Agile Solutions: A Case Study , 2005, XP.

[9]  Raman Ramsin,et al.  The engineering of an object-oriented software development methodology , 2006 .

[10]  Onn Shehory,et al.  A Framework for Evaluating Agent-Oriented Methodologies , 2003, AOIS.

[11]  Mario Piattini,et al.  FMESP: Framework for the modeling and evaluation of software processes , 2006, J. Syst. Archit..

[12]  Brian Fitzgerald,et al.  Toward a conceptual framework of agile methods: a study of agility in different disciplines , 2004, WISER '04.

[13]  B Henderson-Sellers,et al.  Comparative evaluation of XP and scrum using the 4D analytical tool 4DAT , 2006 .

[14]  Ulrich Frank,et al.  A Comparison of two outstanding Methodo- logies for Object-Oriented Design , 2001 .

[15]  Pierre N. Robillard,et al.  Engineering-based processes and agile methodologies for software development: a comparative case study , 2005, J. Syst. Softw..

[16]  Mario Piattini,et al.  FMESP: framework for the modeling and evaluation of software processes , 2004, QUTE-SWAP '04.

[17]  Raman Ramsin,et al.  An Appraisal of Existing Evaluation Frameworks for Agile Methodologies , 2008, 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008).

[18]  R S Pressman,et al.  Software engineering: a practitioner's approach (2nd ed.) , 1986 .

[19]  Alistair Cockburn,et al.  Selecting a Project 's Methodology , 2000, IEEE Softw..

[20]  Pedro Cuesta,et al.  A Framework for Evaluation of Agent Oriented Methodologies ? , 2003 .

[21]  Kenneth H. Rose,et al.  Book Review: A Guide to the Project Management Body of Knowledge (PMBOK® Guide), Fourth Edition , 2001 .

[22]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach , 1982 .

[23]  Pekka Abrahamsson,et al.  New directions on agile methods: a comparative analysis , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[24]  Lucas Layman,et al.  Toward a framework for evaluating extreme programming , 2004, ICSE 2004.

[25]  E. F. Schumacher,et al.  A Guide for the Perplexed , 1977 .

[26]  Agile Manifesto,et al.  Manifesto for Agile Software Development , 2001 .

[27]  Boby George,et al.  Analysis and Quantification of Test Driven Development Approach , 2002 .

[28]  Fabio Kon,et al.  Experiences tracking agile projects: an empirical study , 2006, Journal of the Brazilian Computer Society.

[29]  Fabio Kon,et al.  Tracking the Evolution of Object-Oriented Quality Metrics on Agile Projects , 2007, XP.

[30]  Bernhard Rumpe,et al.  Assumptions Underlying Agile Software-Development Processes , 2005, J. Database Manag..

[31]  R. Wolf A Framework for Evaluation. , 1987 .