Objectives and Challenges of the Utilization of User-Interaction Data in Software Development

Understanding users, their requirements and usage patterns helps building better software. To continuously improve operations, user-interaction (U-I) data can provide developers with interesting new possibilities. This study aims at gaining an understanding of how software teams can start the use of U-I data and what challenges they face with it. In this paper, we describe three cases from different organizations. This includes explaining the activities, objectives, and challenges of each team in their efforts to begin using U-I data. We conducted the study with Action Design Research (ADR) method, resulting in findings from each case by intervening in the work of these teams. As a contribution, we designed a U-I data utilization method that summarizes teams' activities. Secondly, we refined and validated the categorizations of U-I data analysis and utilization objectives, and finally we categorized the challenges that the case teams faced. Together, these contributions lay out clear steps also for other software teams in starting the utilization of U-I data.

[1]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[2]  Jan Bosch,et al.  Post-deployment Data Collection in Software-Intensive Embedded Products , 2013, Continuous Software Engineering.

[3]  Slinger Jansen,et al.  A Reference Framework for Utilization of Software Operation Knowledge , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[4]  Andrew Begel,et al.  Analyze this! 145 questions for data scientists in software engineering , 2013, ICSE.

[5]  Tommi Mikkonen,et al.  Post-Deployment Data: A Recipe for Satisfying Knowledge Needs in Software Development? , 2016, 2016 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement (IWSM-MENSURA).

[6]  Jan Bosch,et al.  Customer Feedback and Data Collection Techniques in Software R&D: A Literature Review , 2015, ICSOB.

[7]  W. Marsden I and J , 2012 .

[8]  Jan Bosch,et al.  TOWARDS R&D AS INNOVATION EXPERIMENT SYSTEMS: A FRAMEWORK FOR MOVING BEYOND AGILE SOFTWARE DEVELOPMENT , 2013, ICSE 2013.

[9]  Jan Bosch,et al.  From Opinions to Data-Driven Software R&D: A Multi-case Study on How to Close the 'Open Loop' Problem , 2014, 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications.

[10]  Newton M. Campos The Lean Startup: How today's entrepreneurs use continuous innovation to create radically successful businesses , 2014 .

[11]  Sampo Suonsyrjä,et al.  Eeny, Meeny, Miny, Mo... - A Multiple Case Study on Selecting a Technique for User-Interaction Data Collecting , 2017, XP.

[12]  Pasi Kuvaja,et al.  Continuous deployment of software intensive products and services: A systematic mapping study , 2017, J. Syst. Softw..

[13]  Jan Bosch,et al.  Towards Customer-Centric Software Development: A Multiple-Case Study , 2015, 2015 41st Euromicro Conference on Software Engineering and Advanced Applications.

[14]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[15]  Xavier Franch,et al.  How Can Quality Awareness Support Rapid Software Development? - A Research Preview , 2017, REFSQ.

[16]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[17]  Sandeep Purao,et al.  Action Design Research , 2011, MIS Q..