From Requirements to Continuous Re-prioritization of Hypotheses

Typically, customer feedback collected in the pre-study, and during the early stages of software development, determines what new features to develop. However, once the decision to develop a new feature is taken, companies stop validating if this feature adds value to its intended customers. Instead, focus is shifted towards developing and implementing the feature. As a result, re-prioritization of feature content is rare, and companies find it difficult to continuously assess and validate feature value. In this paper, we explore the data collection practices in five software development companies. We introduce a model that allows continuous re-prioritization of features. Our model advocates a development approach in which requirements are viewed as hypotheses that need to be continuously validated, and where customer feedback is used to continuously re-prioritize feature content. We identify how the model helps companies transition from early specification of requirements towards continuous re-prioritization of hypotheses.

[1]  Jan Bosch,et al.  Post-deployment Data Collection in Software-Intensive Embedded Products , 2013, Continuous Software Engineering.

[2]  Jan Bosch,et al.  Scale and Responsiveness in Large-Scale Software Development , 2014, IEEE Software.

[3]  Rongqiu Chen,et al.  Customer Participation: Co-Creating Knowledge with Customers , 2008, 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing.

[4]  Jean Hartley,et al.  Case study research , 2004 .

[5]  Franz Lehner,et al.  Requirements Engineering as a Success Factor in Software Projects , 2001, IEEE Softw..

[6]  J. Whitney Case Study Research , 1999 .

[7]  Ron Kohavi,et al.  Online Experimentation at Microsoft , 2009 .

[8]  Jan Bosch,et al.  Post-deployment Data Collection in Software-Intensive Embedded Products , 2013, ICSOB.

[9]  Fabian Fagerholm,et al.  Building blocks for continuous experimentation , 2014, RCoSE 2014.

[10]  Slinger Jansen,et al.  Customer Involvement in Requirements Management: Lessons from Mass Market Software Development , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[11]  Steve Blank The Four Steps to the Epiphany: Successful Strategies for Products that Win , 2013 .

[12]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[13]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[14]  R. Stake The art of case study research , 1995 .

[15]  Karen Skibba Book Review: Qualitative Research Design: An Interactive Approach (2nd ed.) , 2006 .

[16]  Jan Bosch,et al.  Automated User Interaction Analysis for Workflow-Based Web Portals , 2014, ICSOB.

[17]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[18]  Joseph A. Maxwell,et al.  Qualitative Research Design: An Interactive Approach , 1996 .

[19]  Jan Bosch,et al.  Eternal Embedded Software: Towards Innovation Experiment Systems , 2012, ISoLA.

[20]  Jan Bosch,et al.  Towards Continuous Customer Validation: A Conceptual Model for Combining Qualitative Customer Feedback with Quantitative Customer Observation , 2015, ICSOB.

[21]  Jan Bosch,et al.  Towards Data-Driven Product Development: A Multiple Case Study on Post-deployment Data Usage in Software-Intensive Embedded Systems , 2013, LESS.

[22]  Jan Bosch,et al.  Climbing the "Stairway to Heaven" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software , 2012, 2012 38th Euromicro Conference on Software Engineering and Advanced Applications.

[23]  Jan Bosch,et al.  Building Products as Innovation Experiment Systems , 2012, ICSOB.

[24]  Eric Ries,et al.  The lean startup : how constant innovation creates radically successful businesses , 2011 .

[25]  Jan Bosch,et al.  From Opinions to Data-Driven Software R&D: A Multi-case Study on How to Close the 'Open Loop' Problem , 2014, 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications.