Social dogfood: A framework to minimise clouc field defects through crowd sourced testing

Delivering software for the Cloud represents a challenge for both micro teams and Small Medium Enterprises (SMEs), in part due to the rapid release methods adopted and the numerous ways in which software defects can be detected. We study field defect detection rates in a framework where these rates are used to refocus in-house test resources. Using an enterprise dataset, we address the question of what types of defects are found in the field and how soon after a system goes live defects are detected. Our framework can aid both micro teams and SMEs to minimise the number of defects found in the field by maximising internal usage through ‘Dogfood’ programs and by leveraging crowdsourced test methodologies.

[1]  Matthew Lease,et al.  Crowdsourcing for Usability Testing , 2012, ASIST.

[2]  Warren Harrison Eating Your Own Dog Food , 2006, IEEE Softw..

[3]  Moira C. Norrie,et al.  Crowdsourced Web Site Evaluation with CrowdStudy , 2012, ICWE.

[4]  Andreas Prlic,et al.  Ten Simple Rules for the Open Development of Scientific Software , 2012, PLoS Comput. Biol..

[5]  Adam Moskowitz "Eat Your Own Dog Food" , 2003, login Usenix Mag..

[6]  Mark Sullivan,et al.  Software defects and their impact on system availability-a study of field failures in operating systems , 1991, [1991] Digest of Papers. Fault-Tolerant Computing: The Twenty-First International Symposium.

[7]  Barry W. Boehm,et al.  Software Defect Reduction Top 10 List , 2001, Computer.

[8]  Sanjay Misra,et al.  A DISCUSSION ON ASSURING SOFTWARE QUALITY IN SMALL AND MEDIUMSOFTWARE ENTERPRISES: AN EMPIRICAL INVESTIGATION , 2011 .

[9]  Peter C. Kiessler,et al.  A critical look at the bathtub curve , 2003, IEEE Trans. Reliab..

[10]  David Malone,et al.  Social testing: A framework to support adoption of continuous delivery by small medium enterprises , 2015, 2015 Second International Conference on Computer Science, Computer Engineering, and Social Media (CSCESM).

[11]  Jan Marco Leimeister,et al.  Managing crowdsourced software testing: a case study based insight on the challenges of a crowdsourcing intermediary , 2014 .

[12]  Ossi Taipale,et al.  Research Issues for Software Testing in the Cloud , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[13]  Maja Vukovic,et al.  Crowdsourcing for Enterprises , 2009, 2009 Congress on Services - I.