Toward Evidence-Based Organizations: Lessons from Embedded Systems, Online Games, and the Internet of Things

More and more software-intensive companies are adopting data-driven development. Across domains, companies increasingly collect and use data to support development and decision-making activities. Case studies investigated how companies in three domains transition toward data-driven development practices in which continuous collection and analysis of data inform R&D and management. The companies in the online-games and Internet-of-Things domains perform more advanced data collection and analysis, but these practices are also rapidly gaining momentum in the companies in the embedded-systems domain. A proposed model details the levels that software-intensive companies typically move through as they evolve from an opinion-based to an evidence-based organization, in which data informs all the company’s processes.

[1]  Newton M. Campos The Lean Startup: How today's entrepreneurs use continuous innovation to create radically successful businesses , 2014 .

[2]  Ron Kohavi,et al.  Online Experimentation at Microsoft , 2009 .

[3]  Jez Humble,et al.  Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation , 2010 .

[4]  W. R. Howard Agile Project Management: Creating Innovative Products , 2010 .

[5]  Klaus Pohl,et al.  Requirements Engineering - Fundamentals, Principles, and Techniques , 2010 .

[6]  Jan Bosch,et al.  From Opinions to Data-Driven Software R&D: A Multi-case Study on How to Close the 'Open Loop' Problem , 2014, 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications.

[7]  Miryung Kim,et al.  The Emerging Role of Data Scientists on Software Development Teams , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[8]  Laurie A. Williams,et al.  Continuous Deployment at Facebook and OANDA , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C).

[9]  Alexander Verbraeck,et al.  User requirements modeling and analysis of software-intensive systems , 2011, J. Syst. Softw..

[10]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[11]  Jan Bosch,et al.  Climbing the "Stairway to Heaven" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software , 2012, 2012 38th Euromicro Conference on Software Engineering and Advanced Applications.

[12]  Jan Bosch,et al.  Building Products as Innovation Experiment Systems , 2012, ICSOB.

[13]  Jan Bosch,et al.  Modeling continuous integration practice differences in industry software development , 2014, J. Syst. Softw..