Risk Identification at the Interface between Business Case and Requirements

[Motivation:] The requirements engineering (RE) research community is aware of the importance of performing feasibility studies before starting requirements elicitation. Unfortunately, projects still frequently fail to achieve commercial success, responsibility is often unknown, and requirements engineers may be deemed responsible for mistakes made by others. [Problem:] There is neither empirical evidence available from a post-mortem risk analysis for projects that performed adequate RE but commercially failed nor guidance for requirements engineers on validating a business case analysis to mitigate this risk. [Principal idea:] By performing a post-mortem analysis of software development projects that failed to achieve commercial success, we investigate the root causes for the failures and, in most cases, trace the causes back to business case issues. We identify risk areas and provide practical due diligence guidance to the practitioner. [Contribution:] This exploratory case study performs an in-depth review of a detailed post-mortem analysis of three software development projects performed over a 2.5 year period. Each of the analyzed projects failed to make the expected transition to commercialization despite using appropriate RE techniques and achieving satisfactory deliverables. The analysis identifies risk factors that the RE practitioner should consider and we provide a checklist for RE practitioners to use when checking for these risks in an antecedent business case as part of their due diligence. A low-cost commercial viability assessment technique, employing Fermi approximation, is provided to equip the RE practitioner with a risk mitigation tool in the absence of business analyst resources.

[1]  Jaap Gordijn,et al.  Understanding Business Strategies of Networked Value Constellations Using Goal- and Value Modeling , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[2]  Neil A. M. Maiden,et al.  What are the day-to-day factors that are preventing business analysts from effective business analysis? , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[3]  John Mylopoulos,et al.  Business Process-Based Regulation Compliance: The Case of the Sarbanes-Oxley Act , 2007, 15th IEEE International Requirements Engineering Conference (RE 2007).

[4]  B SeamanCarolyn Qualitative Methods in Empirical Studies of Software Engineering , 1999 .

[5]  Austen Rainer,et al.  Case Study Research in Software Engineering - Guidelines and Examples , 2012 .

[6]  George Robson Europump extends quarterly order intake surveys , 2002 .

[7]  James D. Palmer,et al.  Software risk management: requirements-based risk metrics , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[8]  John A. Adam,et al.  Guesstimation: Solving the World's Problems on the Back of a Cocktail Napkin , 2008 .

[9]  Barry W. Boehm,et al.  Value-based software engineering: reinventing , 2003, SOEN.

[10]  Janice Singer,et al.  Studying Software Engineers: Data Collection Techniques for Software Field Studies , 2005, Empirical Software Engineering.

[11]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[12]  Irina Rychkova,et al.  Early Requirements and Business-IT Alignment with SEAM for Business , 2007, 15th IEEE International Requirements Engineering Conference (RE 2007).

[13]  Jon Atle Gulla,et al.  On the challenges of business modeling in large-scale reengineering projects , 2000, Proceedings Fourth International Conference on Requirements Engineering. ICRE 2000. (Cat. No.98TB100219).

[14]  Christof Ebert,et al.  Improving the Exchange of Requirements and Specifications between Business Partners , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[15]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[16]  Janis A. Bubenko,et al.  Challenges in requirements engineering , 1995, Proceedings of 1995 IEEE International Symposium on Requirements Engineering (RE'95).

[17]  J. Knottnerus,et al.  Real world research. , 2010, Journal of clinical epidemiology.

[18]  Walker Royce Software Project Management , 1998 .

[19]  Marjo Kauppinen,et al.  Linking the business view to requirements engineering: long-term product planning by roadmapping , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[20]  Kalle Lyytinen,et al.  A Framework for software risk management , 1996, Scand. J. Inf. Syst..

[21]  Tomoko Nagata,et al.  "Business process" oriented requirements engineering process , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[22]  Tom DeMarco All Late Projects Are the Same , 2011, IEEE Software.

[23]  W. Duncan A GUIDE TO THE PROJECT MANAGEMENT BODY OF KNOWLEDGE , 1996 .

[24]  Vladan Devedzic,et al.  Software Project Management , 2001 .

[25]  Claes Wohlin,et al.  A Value-Based Approach in Requirements Engineering: Explaining Some of the Fundamental Concepts , 2007, REFSQ.

[26]  J Ropponen,et al.  Can software risk management improve system development: an exploratory study , 1997 .

[27]  Anthony Finkelstein,et al.  Software acquisition: a business strategy analysis , 2001, Proceedings Fifth IEEE International Symposium on Requirements Engineering.

[28]  P. I. Zorkoczy Oxford surveys in information technology; vol. 2, 1985 , 1985 .