Operational release planning in large-scale Scrum with multiple stakeholders - A longitudinal case study at F-Secure Corporation

Abstract Context The analysis and selection of requirements are important parts of any release planning process. Previous studies on release planning have focused on plan-driven optimization models. Unfortunately, solving the release planning problem mechanistically is difficult in an agile development context. Objective We describe how a release planning method was employed in two case projects in F-Secure, a large Finnish software company. We identify the benefits which the projects gained from the method, and analyze challenges in the cases and improvements made to the method during the case projects. Method We observed five release planning events and four retrospectives and we conducted surveys in the first two events. We conducted six post-project interviews. We conjoined the observation notes, survey results and interviews and analyzed them qualitatively and quantitatively. Results The focal point of the method was release planning events where the whole project organization gathered to plan the next release. The planning was conducted by the development teams in close collaboration with each other and with the other stakeholders. We identified ten benefits which included improved communication, transparency, dependency management and decision making. We identified nine challenges which included the lacking preparation and prioritization of requirements, unrealistic schedules, insufficient architectural planning and lacking agile mindset. The biggest improvements to the method were the introduction of frequent status checks and a big visible planning status board. Conclusion The release planning method ameliorated many difficult characteristics of the release planning problem but its efficiency was negatively affected by the performing organization that was in transition from a plan-driven to an agile development mindset. Even in this case the benefits clearly outweighed the challenges and the method enabled the early identification of the issues in the project.

[1]  A. Hare,et al.  Group Size , 1981 .

[2]  Günther Ruhe,et al.  A systematic approach for solving the wicked problem of software release planning , 2007, Soft Comput..

[3]  Ken Schwaber The Enterprise and Scrum , 2007 .

[4]  Craig Larman,et al.  Scaling Lean & Agile Development: Thinking and Organizational Tools for Large-Scale Scrum , 2008 .

[5]  Hans van Vliet,et al.  When agile meets the enterprise , 2013, Inf. Softw. Technol..

[6]  Ville Heikkilä,et al.  Rigorous Support for Flexible Planning of Product Releases - A Stakeholder-Centric Approach and Its Initial Evaluation , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[7]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[8]  Claes Wohlin,et al.  A product management challenge: Creating software product value through requirements selection , 2008, J. Syst. Archit..

[9]  Craig Larman,et al.  Practices for Scaling Lean & Agile Development: Large, Multisite, and Offshore Product Development with Large-Scale Scrum , 2010 .

[10]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[11]  Laura Lehtola,et al.  The challenge of release planning , 2011, 2011 Fifth International Workshop on Software Product Management (IWSPM).

[12]  Dietmar Pfahl,et al.  Operational Planning, Re-planning and Risk Analysis for Software Releases , 2007, PROFES.

[13]  Juan Gutiérrez Plaza,et al.  Evolution of Longer-Term Planning in a Large Scale Agile Project - F-Secure's Experience , 2011, XP.

[14]  Hans Christian Benestad,et al.  A comparison of model-based and judgment-based release planning in incremental software projects , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[15]  Pär Carlshamre,et al.  Release Planning in Market-Driven Software Product Development: Provoking an Understanding , 2002, Requirements Engineering.

[16]  JaatunMartin Gilje,et al.  Agile Software Development , 2002, Comput. Sci. Educ..

[17]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[18]  Tony Gorschek,et al.  The impact of agile principles on market-driven software product development , 2010, J. Softw. Maintenance Res. Pract..

[19]  Kim Pries,et al.  Scrum Project Management , 2010 .

[20]  martin white Book Review: Manage It! Your Guide to Modern, Pragmatic Project Management , 2008 .

[21]  Elena García Barriocanal,et al.  Empirical findings on team size and productivity in software development , 2012, J. Syst. Softw..

[22]  Andraž Cej,et al.  Agile software development with Scrum , 2010 .

[23]  Barry W. Boehm,et al.  Requirements that Handle IKIWISI, COTS, and Rapid Change , 2000, Computer.

[24]  Lionel Bouchard,et al.  Multimedia Software for Mobile Phones , 2010, IEEE Software.

[25]  Slinger Jansen,et al.  The Agile Requirements Refinery: Applying SCRUM Principles to Software Product Management , 2009, 2009 Third International Workshop on Software Product Management.

[26]  Günther Ruhe,et al.  Release planning process improvement - an industrial case study , 2006, Softw. Process. Improv. Pract..

[27]  Casper Lassenius,et al.  Scaling Scrum in a Large Distributed Project , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[28]  Khaled El Emam,et al.  A Replicated Survey of IT Software Project Failures , 2008, IEEE Software.

[29]  Dietmar Pfahl,et al.  SIMULATION-BASED UNCERTAINTY ANALYSIS FOR PLANNING PARAMETERS IN OPERATIONAL PRODUCT MANAGEMENT , 2007 .

[30]  Helen Sharp,et al.  The Top 10 Burning Research Questions from Practitioners , 2010, IEEE Softw..

[31]  Casper Lassenius,et al.  Continuous Release Planning in a Large-Scale Scrum Development Organization at Ericsson , 2013, XP.

[32]  Dean Leffingwell,et al.  Agile Software Requirements: Lean Requirements Practices for Teams, Programs, and the Enterprise , 2011 .

[33]  Dean Leffingwell,et al.  Scaling Software Agility: Best Practices for Large Enterprises (The Agile Software Development Series) , 2007 .

[34]  Günther Ruhe,et al.  Hybrid Intelligence in Software Release Planning , 2004, Int. J. Hybrid Intell. Syst..

[35]  Tony Gorschek,et al.  Investigating Impact of Business Risk on Requirements Selection Decisions , 2009, 2009 35th Euromicro Conference on Software Engineering and Advanced Applications.

[36]  Slinger Jansen,et al.  A Revelatory Case Study on Scaling Agile Release Planning , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[37]  M. Patton Qualitative research and evaluation methods , 1980 .

[38]  Günther Ruhe,et al.  Bi-objective release planning for evolving software systems , 2007, ESEC-FSE '07.

[39]  H L BALMFORTH Operational planning. , 1960, Canadian hospital.

[40]  Joseph Momoh,et al.  Strategic Release Planning and Evaluation of Operational Feasibility , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[41]  H. Kittlaus,et al.  Software Product Management and Pricing: Key Success Factors for Software Organizations , 2009 .

[42]  Anders Wall,et al.  Importance of Software Architecture during Release Planning , 2008, Seventh Working IEEE/IFIP Conference on Software Architecture (WICSA 2008).

[43]  Marjo Kauppinen,et al.  Requirements Prioritization Challenges in Practice , 2004, PROFES.

[44]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[45]  R. Feldt,et al.  A systematic review on strategic release planning models , 2010, Inf. Softw. Technol..

[46]  S. Wheelan,et al.  Group Size, Group Development, and Group Productivity , 2009 .

[47]  Kevin Logue,et al.  Agile Release Planning: Dealing with Uncertainty in Development Time and Business Value , 2008, 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008).

[48]  Björn Regnell,et al.  An industrial survey of requirements interdependencies in software product release planning , 2001, Proceedings Fifth IEEE International Symposium on Requirements Engineering.

[49]  Torgeir Dingsøyr,et al.  A decade of agile methodologies: Towards explaining agile software development , 2012, J. Syst. Softw..

[50]  Juan Li,et al.  A risk-driven method for eXtreme programming release planning , 2006, ICSE.

[51]  Tsun Chow,et al.  A survey study of critical success factors in agile software projects , 2008, J. Syst. Softw..

[52]  Mike Cohn,et al.  Agile Estimating and Planning , 2005 .