Causal relationships between improvements in software development processes and final software product quality

A main assumption of software process improvement (SPI) is that improvements in a software development process result in higher quality software products. In other words, SPI assumes the existence of causal relations between process and product characteristics. To what extent have these causal relations, however, been explored? Which specific process improvements have which particular impact on which particular product quality attributes? In this paper an overview is given of these “software process and product dependencies” (PPD). This overview comprises of a list of SPI-techniques and the associated product quality attributes that are addressed with these techniques. The extent of the causality is investigated and whether there is a possibility to identify more or less effective strategies for product quality improvement. The overview is based on a literature study and expert evaluation. The research is summarised in a matrix of both software process elements and associated software product quality characteristics. This matrix contains both satisfactory and unsatisfactory results. On the one hand, a promising extensive base of publications on techniques and methods was identified. On the other, a disappointing deficiency of empirical validation regarding the actual impact of those techniques on product quality is also prominent. As it is, we remain with an inadequate and incomplete indication of the product characteristics that particular software process improvement techniques intend to ameliorate. This article, therefore, hopefully, also provides a basis for discussion on the need to make process-product dependencies more explicit.

[1]  Alfred Kobsa,et al.  User Modeling for Personalized City Tours , 2002, Artificial Intelligence Review.

[2]  Kenneth L. Kraemer,et al.  Electronic business adoption by European firms: a cross-country assessment of the facilitators and inhibitors , 2003, Eur. J. Inf. Syst..

[3]  Rob Law,et al.  Website Development and Evaluations in Tourism: A Retrospective Analysis , 2006, ENTER.

[4]  Richard G. Moore,et al.  The Internet as a Distribution Channel , 1998 .

[5]  A. Masters,et al.  Endogenous credit-card acceptance in a model of precautionary demand for money , 2004 .

[6]  Gustavus J. Simmons,et al.  Symmetric and Asymmetric Encryption , 1979, CSUR.

[7]  Holger Hermanns,et al.  A Markov Chain Model Checker , 2000, TACAS.

[8]  John D. Musa,et al.  Software Reliability Engineering , 1998 .

[9]  Alok Gupta,et al.  GIST: A Model for Design and Management of Content and Interactivity of Customer-Centric Web Sites , 2004, MIS Q..

[10]  J. Gower A General Coefficient of Similarity and Some of Its Properties , 1971 .

[11]  Shari Lawrence Pfleeger,et al.  Software Engineering: The Production of Quality Software , 1987 .

[12]  Costas Zafiropoulos,et al.  A Framework for the Evaluation of Hotel Websites: The Case of Greece , 2006, J. Inf. Technol. Tour..

[13]  Edmund M. Clarke,et al.  Model Checking , 1999, Handbook of Automated Reasoning.

[14]  Jan J. M. M. Rutten,et al.  Mathematical techniques for analyzing concurrent and probabilistic systems , 2004, CRM monograph series.

[15]  David A. Fisher,et al.  C4 Software Technology Reference Guide - A Prototype. , 1997 .

[16]  Tom Coffey,et al.  Non-repudiation with mandatory proof of receipt , 1996, CCRV.

[17]  Marco Pistore,et al.  NuSMV 2: An OpenSource Tool for Symbolic Model Checking , 2002, CAV.

[18]  Kenneth L. Kraemer,et al.  Information technology and economic performance , 2003, ACM Comput. Surv..

[19]  Ping Zhang,et al.  Satisfiers and dissatisfiers: a two-factor model for website design and evaluation , 2000 .

[20]  Shin Nakajima,et al.  The SPIN Model Checker : Primer and Reference Manual , 2004 .

[21]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[22]  Dimitrios Buhalis,et al.  eTourism Developments in Greece , 2003, ENTER.

[23]  Kenneth L. Kraemer,et al.  A Cross-Country Investigation of the Determinants of Scope of E-commerce Use: An Institutional Approach , 2004, Electron. Mark..

[24]  Taeko Ariga,et al.  Teaching e-commerce Web page evaluation and design: a pilot study using tourism destination sites , 2006, Comput. Educ..

[25]  Paul Stoneman,et al.  THE DIFFUSION OF E-BUSINESS ACTIVITIES IN THE UK: PRODUCTIVITY, PROFITABILITY, EXTERNALITIES AND POLICY , 2004 .

[26]  Subhash Sharma Applied multivariate techniques , 1995 .

[27]  Dirk Pilat,et al.  Productivity Growth in ICT-producing and ICT-using Industries: A Source of Growth Differentials in the OECD? , 2001 .

[28]  van Dm Rini Solingen,et al.  Product focused software process improvement : SPI in the embedded software domain , 2000 .

[29]  J. Filar,et al.  Competitive Markov Decision Processes , 1996 .

[30]  Chern Li Liew,et al.  Online cultural heritage exhibitions: a survey of information retrieval features , 2005, Program.

[31]  Patiwat Panurach,et al.  Money in electronic commerce: digital cash, electronic fund transfer, and Ecash , 1996, CACM.

[32]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User modeling and user-adapted interaction.

[33]  Jerome Svigals Smart cards: The new bank cards , 1987 .

[34]  Andrea Bianco,et al.  Model Checking of Probabalistic and Nondeterministic Systems , 1995, FSTTCS.

[35]  Marko Mäkelä,et al.  Maria: Modular Reachability Analyser for Algebraic System Nets , 2002, ICATPN.

[36]  Heinz Hollenstein,et al.  Determinants of the Adoption of Information and Communication Technologies (ICT) , 2002 .

[37]  Rodolfo Baggio,et al.  On the Significance of Tourism Website Evaluations , 2006, ENTER.

[38]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[39]  Giuliana Battisti,et al.  Inter- and intra-firm effects in the diffusion of new process technology , 2003 .

[40]  Barry Fisher,et al.  Introducing a Business Information System into an Engineering Company , 2000, Inf. Knowl. Syst. Manag..

[41]  Jane Hillston,et al.  A compositional approach to performance modelling , 1996 .

[42]  Mark C. Paulk,et al.  Key Practices of the Capability Maturity Model , 1991 .

[43]  Karl Gregory,et al.  Internet marketing in the internationalisation of UK SMEs , 1997 .

[44]  Jung P. Shim,et al.  Factors influencing corporate web site adoption: a time-based assessment , 2001, Inf. Manag..

[45]  Pasi Kuvaja Software Process Assessment and Improvement: The BOOTSTRAP Approach , 1994 .

[46]  Andrew Hinton,et al.  PRISM: A Tool for Automatic Verification of Probabilistic Systems , 2006, TACAS.

[47]  李幼升,et al.  Ph , 1989 .

[48]  M. Greenstein,et al.  Electronic Commerce: Security Risk Management and Control , 1999 .

[49]  Hannes Werthner,et al.  Information Technology and Tourism — A Challenging Relationship , 1999 .

[50]  Dietmar Pfahl,et al.  Experience with explicit modelling of relationships between process and product quality , 1998 .

[51]  Mark Levene,et al.  An Introduction to Search Engines and Web Navigation (2. ed.) , 2005 .

[52]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[53]  Dolores R. Wallace,et al.  Software Error Analysis , 1995 .

[54]  Dimitris Kanellopoulos,et al.  Exploiting tourism destinations' knowledge in an RDF-based P2P network , 2008, J. Netw. Comput. Appl..

[55]  Alice M. Rivlin,et al.  Projecting the economic impact of the Internet , 2001 .

[56]  Charlene L. Nicholls-Nixon Rapid growth and high performance: The entrepreneur's “impossible dream?” , 2005 .

[57]  Georgios I. Doukidis,et al.  Trends in information technology in small businesses , 1994 .

[58]  N. Melone A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[59]  Tiago Oliveira,et al.  Determinants of information technology diffusion: A study at the firm level for Portugal , 2007 .

[60]  S. G. E. Garrett,et al.  An Introduction to Electronic Commerce , 1999 .

[61]  Jean-Pierre Kuilboer,et al.  E-business and e-commerce infrastructure : technologies supporting the e-business initiative , 2001 .

[62]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[63]  Barry Boehm,et al.  Characteristics of software quality , 1978 .

[64]  Christel Baier,et al.  Model checking for a probabilistic branching time logic with fairness , 1998, Distributed Computing.

[65]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[66]  Tom Gilb,et al.  Principles of software engineering management , 1988 .

[67]  A. Tjoa,et al.  Information and Communication Technologies in Tourism , 1996, Springer Vienna.

[68]  A Min Tjoa,et al.  Information and Communications Technologies in Tourism , 1994, Springer Vienna.

[69]  John M. Ward,et al.  Understanding the successful adoption and use of IS/IT in SMEs: an explanation from Portuguese manufacturing industries , 2002, Inf. Syst. J..

[70]  A. Carr,et al.  Communication methods, information sharing, supplier development and performance , 2007 .

[71]  M. Haliassos,et al.  Credit Card Debt Puzzles , 2005, SSRN Electronic Journal.

[72]  Ulrike Gretzel,et al.  Evaluation of Emerging Technologies in Tourism: The Case of Travel Search Engines , 2006, ENTER.

[73]  Kenneth L. McMillan,et al.  Symbolic model checking , 1992 .

[74]  Douglas Tudhope,et al.  Usability Evaluation for Museum Web Sites , 2001 .

[75]  Marta Z. Kwiatkowska,et al.  PRISM 2.0: a tool for probabilistic model checking , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[76]  Kevin Zhu,et al.  Migrating to internet-based e-commerce: Factors affecting e-commerce adoption and migration at the firm level , 2006, Inf. Manag..

[77]  Karthik N. S. Iyer,et al.  Supply chain B2B e‐commerce and time‐based delivery performance , 2004 .

[78]  Rob Law,et al.  Successful Factors For A Travel Web Site: Perceptions Of On-Line Purchasers In Hong Kong , 2003 .

[79]  Giuliana Battisti,et al.  INTER AND INTRA FIRM DIFFUSION OF ICT IN THE UNITED KINGDOM (UK) AND SWITZERLAND (CH) AN INTERNATIONALLY COMPARATIVE STUDY BASED ON FIRM-LEVEL DATA , 2007 .

[80]  Thompson S. H. Teo,et al.  A model for Web adoption , 2004, Inf. Manag..

[81]  Thompson S. H. Teo,et al.  A contingency perspective on Internet adoption and competitive advantage , 2003, Eur. J. Inf. Syst..

[82]  Sudhanshu Sekhar Pani,et al.  Buy Now, Pay Later , 2022, SSRN Electronic Journal.

[83]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User Modeling and User-Adapted Interaction.

[84]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[85]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[86]  Mladen A. Vouk Software Reliability Engineering , 1999 .

[87]  Anna Giunta,et al.  Understanding the determinants of information technology adoption: evidence from Italian manufacturing firms , 2007 .

[88]  Sandra E. Black,et al.  How to Compete: The Impact of Workplace Practices and Information Technology on Productivity , 1997, Review of Economics and Statistics.

[89]  Paul Miller,et al.  Re-inventing the Wheel? Standards, Interoperability and Digital Cultural Content , 2002, D Lib Mag..