Developing the right features: the role and impact of customer and product data in software product development

Software product development companies are increasingly striving to become data-driven. The access to customer feedback and product data has been, with products increasingly becoming connected to the Internet, demonetized. Systematically collecting the feedback and efficiently using it in product development, however, are challenges that large-scale software development companies face today when being faced by large amounts of available data. In this thesis, we explore the collection, use and impact of customer feedback on software product development. We base our work on a 2-year longitudinal multiple-case study research with case companies in the software-intensive domain, and complement it with a systematic review of the literature. In our work, we identify and confirm that large-software companies today collect vast amounts of feedback data, however, struggle to effectively use it. And due to this situation, there is a risk of prioritizing the development of features that may not deliver value to customers. Our contribution to this problem is threefold. First, we present a comprehensive and systematic review of activities and techniques used to collect customer feedback and product data in software product development. Next, we show that the impact of customer feedback evolves over time, but due to the lack of sharing of the collected data, companies do not fully benefit from this feedback. Finally, we provide an improvement framework for practitioners and researchers to use the collected feedback data in order to differentiate between different feature types and to model feature value during the lifecycle. With our contributions, we aim to bring soft-

[1]  Newton M. Campos.  The Lean Startup: How today's entrepreneurs use continuous innovation to create radically successful businesses , 2014 .

[2]  Jan Bosch,et al.  The Lack of Sharing of Customer Data in Large Software Organizations: Challenges and Implications , 2016, XP.

[3]  Jan Bosch,et al.  Climbing the "Stairway to Heaven" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software , 2012, 2012 38th Euromicro Conference on Software Engineering and Advanced Applications.

[4]  Scott E. Sampson.  Ramifications of Monitoring Service Quality Through Passively Solicited Customer Feedback , 1996 .

[5]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[6]  R. Dorf,et al.  The Balanced Scorecard: Translating Strategy Into Action , 1997, Proceedings of the IEEE.

[7]  A. Payne,et al.  Managing the co-creation of value , 2008 .

[8]  Jan Bosch,et al.  Customer Feedback and Data Collection Techniques in Software R&D: A Literature Review , 2015, ICSOB.

[9]  Jan Bosch,et al.  Early Value Argumentation and Prediction: An Iterative Approach to Quantifying Feature Value , 2015, PROFES.

[10]  Fabian Fagerholm,et al.  Building blocks for continuous experimentation , 2014, RCoSE 2014.

[11]  Alexander L. Wolf,et al.  Acm Sigsoft Software Engineering Notes Vol 17 No 4 Foundations for the Study of Software Architecture , 2022 .

[12]  Michael Jackson,et al.  Distributed Feature Composition: A Virtual Architecture for Telecommunications Services , 1998, IEEE Trans. Software Eng..

[13]  David Lorge Parnas,et al.  Software aging , 1994, Proceedings of 16th International Conference on Software Engineering.

[14]  D. Leonard-Barton.  CORE CAPABILITIES AND CORE RIGIDITIES: A PARADOX IN MANAGING NEW PRODUCT DEVELOPMENT , 1992 .

[15]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[16]  Jan Bosch,et al.  Achieving Simplicity with the Three-Layer Product Model , 2013, Computer.

[17]  Jeffrey S. Pinegar.  What Customers Want: Using Outcome‐Driven Innovation to Create Breakthrough Products and Services by Anthony W. Ulwick , 2006 .

[18]  R. Cooper,et al.  New Product Portfolio Management : Practices and Performance , 1999 .

[19]  Mario Kolberg,et al.  Feature interaction: a critical review and considered forecast , 2003, Comput. Networks.

[20]  Ron Kohavi,et al.  Responsible editor: R. Bayardo. , 2022 .

[21]  Jürgen Münch,et al.  Software Development as an Experiment System: A Qualitative Survey on the State of the Practice , 2015, XP.

[22]  Linda Gorchels.  The Product Manager's Handbook , 1995 .

[23]  Pasi Kuvaja,et al.  Continuous deployment of software intensive products and services: A systematic mapping study , 2017, J. Syst. Softw..

[24]  David Cohen,et al.  Improving software investments through requirements validation , 2001, Proceedings 26th Annual NASA Goddard Software Engineering Workshop.

[25]  Jürgen Münch,et al.  GQM^+ Strategies -- Aligning Business Strategies with Software Measurement , 2007, ESEM 2007.

[26]  Jan Bosch,et al.  Towards Continuous Customer Validation: A Conceptual Model for Combining Qualitative Customer Feedback with Quantitative Customer Observation , 2015, ICSOB.

[27]  Jeffrey M. Sullivan,et al.  Impediments to and incentives for automation in the Air Force , 2005, Proceedings. 2005 International Symposium on Technology and Society, 2005. Weapons and Wires: Prevention and Safety in a Time of Fear. ISTAS 2005..

[28]  Jyri Vilko,et al.  Value Creation in Product-Service Supply Networks , 2014 .