The Influence of Software Process Maturity and Customer Error Reporting on Software Release and Pricing

Software producers are making greater use of customer error reporting to discover defects and improve the quality of their products. We study how software development differences among producers e.g., varying levels of process maturity and software class and functionality differences e.g., operating system versus productivity software affect how these producers coordinate software release timing and pricing to optimally harness error reporting contributions from users. In settings where prices are fixed, we characterize the optimal release time and demonstrate why in some cases it can actually be preferable to delay release when customer error reporting rates increase. The manner in which a firm's optimal release time responds to increases in software functionality critically hinges on whether the added functionality enhances or dilutes user error reporting; in both cases, the effect of added functionality on release timing can go in either direction, depending on both firm and product market characteristics. For example, when processing costs are relatively large compared with goodwill costs, firms with lower process maturity will release earlier when per-module error reporting contributions become diluted and release later when these contributions become enhanced. We also examine how a firm adapts price with changes in error reporting levels and software functionality, and finally, we provide implications of how beta testing influences release timing. This paper was accepted by Lorin Hitt, information systems.

[1]  Terrence August,et al.  Who Should be Responsible for Software Security? A Comparative Analysis of Liability Policies in Network Environments , 2011, WEIS.

[2]  Bruce R. Robinson,et al.  Dynamic Price Models for New-Product Planning , 1975 .

[3]  Shigeru Yamada,et al.  Optimal software release policies for a non-homogeneous software error detection rate model , 1986 .

[4]  C. Mallows,et al.  When Should One Stop Testing Software , 1988 .

[5]  D. M. Topkis Supermodularity and Complementarity , 1998 .

[6]  Mark C. Paulk,et al.  Capability Maturity Model for Software , 2001 .

[7]  Min Xie,et al.  A study of the sensitivity of software release time , 1998, J. Syst. Softw..

[8]  Eric S. Raymond,et al.  The cathedral and the bazaar - musings on Linux and Open Source by an accidental revolutionary , 2001 .

[9]  R A Stephens CONNECTING WITH CUSTOMERS , 1991 .

[10]  Suresh P. Sethi,et al.  Optimal Software Development: A Control Theoretic Approach , 2004, Inf. Syst. Res..

[11]  Gerald L. Thompson,et al.  Optimal Pricing and Advertising Policies for New Product Oligopoly Models , 1984 .

[12]  Abraham Seidmann,et al.  Perpetual Versus Subscription Licensing Under Quality Uncertainty and Network Externality Effects , 2010, J. Manag. Inf. Syst..

[13]  Noopur Davis,et al.  The Team Software ProcessSM (TSPSM) in Practice: A Summary of Recent Results , 2003 .

[14]  Michael A. Cusumano,et al.  Who is liable for bugs and security flaws in software? , 2004, CACM.

[15]  Vijay S. Mookerjee,et al.  Optimal Enhancement and Lifetime of Software Systems: A Control Theoretic Analysis: Optimal Enhancement and Lifetime of Software Systems , 2011 .

[16]  D. J. Wu,et al.  Engineering Optimal Network Effects via Social Media Features and Seeding in Markets for Digital Goods and Services , 2013, Inf. Syst. Res..

[17]  Westley Weimer,et al.  Modeling bug report quality , 2007, ASE '07.

[18]  Sandra Slaughter,et al.  Quality Improvement and Infrastructure Activity Costs in Software Development: A Longitudinal Analysis , 2003, Manag. Sci..

[19]  Frank M. Bass,et al.  A New Product Growth for Model Consumer Durables , 2004, Manag. Sci..

[20]  Vijay S. Mookerjee,et al.  Optimal Enhancement and Lifetime of Software Systems: A Control Theoretic Analysis , 2010 .

[21]  Chris F. Kemerer,et al.  Ieee Transactions on Software Engineering, Manuscript Id 1 Does Software Process Improvement Reduce the Severity of Defects? a Longitudinal Field Study , 2022 .

[22]  Mark C. Paulk,et al.  Capability Maturity Model for Software, Version 1.1 , 1993 .

[23]  Varghese S. Jacob,et al.  Post-Release Testing and Software Release Policy for Enterprise-Level Systems , 2012, Inf. Syst. Res..

[24]  Michael R. Lyu,et al.  Optimal release time for software systems considering cost, testing-effort, and test efficiency , 2005, IEEE Transactions on Reliability.

[25]  Paul N. Otto Reasonableness Meets Requirements: Regulating Security and Privacy in Software , 2009 .

[26]  Hao Xu,et al.  Optimal Policy for Software Vulnerability Disclosure , 2008, Manag. Sci..

[27]  S. Kalish,et al.  A MARKET ENTRY TIMING MODEL FOR NEW TECHNOLOGIES * , 2004 .

[28]  Dipak C. Jain,et al.  Why the Bass Model Fits without Decision Variables , 1994 .

[29]  Harald C. Gall,et al.  Predicting the fix time of bugs , 2010, RSSE '10.

[30]  Teck-Hua Ho,et al.  New product development: the performance and time-to-market tradeoff , 1996 .

[31]  Hani I. Mesak,et al.  Monopolist optimum pricing and advertising policies for diffusion models of new product innovations , 1998 .

[32]  Simon P. Wilson,et al.  Deciding How Long to Test Software , 2001 .

[33]  Shaohui Zheng Dynamic release policies for software systems with a reliability constraint , 2002 .

[34]  Shunji Osaki,et al.  Optimum Release Policies for a Software System with a Scheduled Software Delivery Time , 1984 .

[35]  G. Thompson,et al.  Optimal Control Theory: Applications to Management Science and Economics , 2000 .

[36]  Mayuram S. Krishnan,et al.  Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development , 2000 .

[37]  M. S. Krishnan,et al.  An Empirical Analysis of Productivity and Quality in Software Products , 2000 .

[38]  S. Kalish Monopolist Pricing with Dynamic Demand and Production Cost , 1983 .

[39]  Shigeru Yamada,et al.  Optimal software release policies with simultaneous cost and reliability requirements , 1987 .

[40]  Terrence August,et al.  Let the Pirates Patch? An Economic Analysis of Software Security Patch Restrictions , 2008, Inf. Syst. Res..

[41]  James A. Whittaker Software's Invisible Users , 2001, IEEE Softw..

[42]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[43]  Eric S. Raymond,et al.  The Cathedral and the Bazaar , 2000 .

[44]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[45]  Cmmi Product Team CMMI for Development, Version 1.2 , 2010 .

[46]  Huseyin Cavusoglu,et al.  Efficiency of Vulnerability Disclosure Mechanisms to Disseminate Vulnerability Knowledge , 2007, IEEE Transactions on Software Engineering.

[47]  S. Sethi,et al.  Optimal pricing in a hazard rate model of demand , 2003 .

[48]  Sy-Yen Kuo,et al.  Optimal Release Times for Software Systems with Scheduled Delivery Time Based on the HGDM , 1997, IEEE Trans. Computers.

[49]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[50]  Gregory Tassey,et al.  Prepared for what , 2007 .

[51]  Thomas Zimmermann,et al.  What Makes a Good Bug Report? , 2008, IEEE Transactions on Software Engineering.

[52]  Anand Mendepalli Connecting with Customers , 2012 .

[53]  Harvey S. Koch,et al.  Optimal Release Time of Computer Software , 1983, IEEE Transactions on Software Engineering.

[54]  S. Tufekci,et al.  Application of a software reliability model to decide software release time , 1983 .

[55]  Gary L. Lilien,et al.  A market entry timing model for new techniques , 1986 .

[56]  Rahul Telang,et al.  Research Note - Sell First, Fix Later: Impact of Patching on Software Quality , 2006, Manag. Sci..

[57]  Trichy V. Krishnan,et al.  Optimal Pricing Strategy for New Products , 1999 .

[58]  Jun Zhang,et al.  Security Patch Management: Share the Burden or Share the Damage? , 2008, Manag. Sci..

[59]  Abel P. Jeuland,et al.  Experience Curves and Dynamic Demand Models: Implications for Optimal Pricing Strategies , 1981 .

[60]  Hoang Pham,et al.  Software release policies with gain in reliability justifying the costs , 1999, Ann. Softw. Eng..

[61]  Marius F. Niculescu,et al.  Underlying Consumer Heterogeneity in Markets for Subscription-Based IT Services with Network Effects , 2012, Inf. Syst. Res..

[62]  E. Dockner,et al.  Dynamic Strategic Pricing and Speed of Diffusion , 2004 .

[63]  David A. Wheeler More Than a Gigabuck: Estimating GNU/Linux''s Size , 2002, WWW 2002.

[64]  Min Xie,et al.  A Study of the Effect of Imperfect Debugging on Software Development Cost , 2003, IEEE Trans. Software Eng..

[65]  Khawaja Asjad Saeed,et al.  Examining user involvement in continuous software development: (a case of error reporting system) , 2009, CACM.

[66]  Terrence August,et al.  Network Software Security and User Incentives , 2006, Manag. Sci..

[67]  Daniel Lucrédio,et al.  An Initial Study on the Bug Report Duplication Problem , 2010, 2010 14th European Conference on Software Maintenance and Reengineering.

[68]  Shigeru Yamada,et al.  Economic analysis of software release problems with warranty cost and reliability requirement , 1999 .

[69]  Willa K. Ehrlich,et al.  Determining the cost of a stop-test decision (software reliability) , 1993, IEEE Software.