Measurements in the Early Stage Software Start-ups: A Multiple Case Study in a Nascent Ecosystem

Abstract Context: Software measurement is crucial to stay competitive and deliver quality software products. Problem: While much research has been done on measurement in large companies in developed countries, there is limited research on measurement in start-ups. So far there are no studies on whether these results apply to nascent ecosystems, such as those in East Africa. Goal: The aim of this study is to understand the use and perceived benefits of measurement in software start-ups in East Africa. Method: We performed a multi-case study on 19 software start-ups in hubs in Uganda and Kenya, through conducting semi-structured interviews. We transcribed and analyzed them using the content analysis technique. Results: We identified that start-ups are using a number of business and product-oriented metrics. Furthermore, we found no evidence on the use of design-oriented metrics. Nonetheless, start-ups have considerable expectations on the benefits of measuring. Finally, metrics found in this study partially differ from metrics used in start-ups in developed countries. Conclusion: There is a need to create a more inclusive characterization for measurement as early start-ups in East Africa cannot yet be represented with known models.

[1]  Yunfei Shi,et al.  Early-Stage Software Start-up Survival: the Effects of Managerial Actions on Firm Performance , 2015, HCI.

[2]  Tony Gorschek,et al.  Software Engineering Knowledge Areas in Startup Companies: A Mapping Study , 2015, ICSOB.

[3]  Pekka Abrahamsson,et al.  Why Early-Stage Software Startups Fail: A Behavioral Framework , 2014, ICSOB.

[4]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[5]  Pekka Abrahamsson,et al.  Software Product Size Measurement Methods: A Systematic Mapping Study , 2014, 2014 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement.

[6]  Jonathan Chard,et al.  A measurement maturity model , 1993, Software Quality Journal.

[7]  M. N. Das Statistical methods and concepts , 1989 .

[8]  Robert K. Yin,et al.  Case Study Research and Applications: Design and Methods , 2017 .

[9]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[10]  Robert K. Yin,et al.  Applications of case study research , 1993 .

[11]  Newton M. Campos The Lean Startup: How today's entrepreneurs use continuous innovation to create radically successful businesses , 2014 .

[12]  Alistair R. Anderson,et al.  Success in Israeli high-tech start-ups; Critical factors and process , 2006 .

[13]  P. Bourne,et al.  APPLICATIONS OF CASE STUDY RESEARCH - REVIEW , 2017 .

[14]  Juan Garbajosa,et al.  Software Startups - A Research Agenda , 2016, e Informatica Softw. Eng. J..

[15]  Pekka Abrahamsson,et al.  Minimum Viable Product or Multiple Facet Product? The Role of MVP in Software Startups , 2016, XP.

[16]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[17]  Félix García,et al.  MIS-PyME software measurement capability maturity model - Supporting the definition of software measurement programs and capability determination , 2010, Adv. Eng. Softw..

[18]  Emilia Mendes,et al.  Software productivity measurement using multiple size measures , 2004, IEEE Transactions on Software Engineering.

[19]  M. Crowne,et al.  Why software product startups fail and what to do about it. Evolution of software product development in startup companies , 2002, IEEE International Engineering Management Conference.

[20]  Victor Pantano,et al.  Insights from the Balanced Scorecard Performance measurement systems: successes, failures and future - a review , 2006 .

[21]  Tony Gorschek,et al.  Software development in startup companies: A systematic mapping study , 2014, Inf. Softw. Technol..

[22]  Stanley M. Sutton The Role of Process in a Software Start-up , 2000, IEEE Softw..

[23]  Miroslaw Staron,et al.  MeSRAM - A method for assessing robustness of measurement programs in large software development organizations and its industrial evaluation , 2016, J. Syst. Softw..

[24]  Fabio Kon,et al.  Designing a Maturity Model for Software Startup Ecosystems , 2015, PROFES.

[25]  Robert H Yacobellis,et al.  A Method for Assessing Software Measurement Technology , 1990 .

[26]  Robert E. Park,et al.  Software Size Measurement: A Framework for Counting Source Statements , 1992 .

[27]  Nopadol Rompho Operational performance measures for startups , 2018 .

[28]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[29]  M. Patton Qualitative research and evaluation methods , 1980 .

[30]  Alain Abran,et al.  Software Metrics and Software Metrology , 2010 .