Situational Process Improvement in Software Product Management

Product management has become an essential strategic practice in most companies. This is increasingly more so in the software domain. Here organizations are rapidly evolving their products, have to deal with thousands of requirements, large numbers of stakeholders, and the alignment between products and strategy. A good product manager needs to understand what the consumer is going to buy, make sure it gets built, and ensure it is done profitably. To successfully compete, product managers must not only focus on the product itself, but on the entire software product management (SPM) lifecycle. If the SPM activities do not get enough attention, the quality of a product decreases, release dates are not met, and managing customers’ expectations becomes a large problem. Many software product management organizations (SPMOs) have implemented customized processes for SPM based on their situational characteristics. There has been research into the situational factors that influence this customization, but the precise effects of the situational factors are nearly never detailed. Nor is a method provided which incorporates the situational aspects and has been applied in practice. The main research question for this dissertation therefore is: How can software product management practices be improved in a situational manner? This research question is answered in three parts. The first part presents an overview of all practices that constitute SPM. The overview consists of the SPM competence model that shows the high level practices that constitute SPM, and the SPM maturity matrix that lists all of the low level practices within the high level practices in a best practice implementation order. SPM organizations can use this matrix to map and improve their SPM practices incrementally. The next part of the dissertation provides an overview of the situational factors that affect SPM. Its main result, the situational factor effects catalog (SFEC), provides this overview by showing in detail three different types of effects that situational factors have on the implemented SPM practices and the implementation thereof: 1) The effects situational factors have on the practices that are implemented in the daily practice of SPM. 2) The effects situational factors have on the practices that should be implemented by an SPMO. 3) The effects situational factors have in the selection process of method fragments to fulfill those practices. Researchers can use the SFEC in the development of method fragments and software process improvement models, and practitioners can use it to gain insight into the effects of changes in their situational characteristics. The third part of the dissertation presents a method with which SPMOs can assess and improve their SPM in a situational manner: the situational assessment method (SAM). This incremental assessment method presents SPMOs with an assessment of their current maturity level, and suggests improvements based on their situational context. The context of an organization into account by examining various situational factors which are used to determine the capabilities that apply to the SPMO being assessed.

[1]  L WolfAlexander,et al.  Software process validation , 1999 .

[2]  Tony Gorschek,et al.  Goal-Oriented Requirements Communication in New Product Development , 2008, 2008 Second International Workshop on Software Product Management.

[3]  Kathleen M. Eisenhardt,et al.  Theory Building From Cases: Opportunities And Challenges , 2007 .

[4]  Jeff Sutherland,et al.  Scrum and CMMI Going from Good to Great , 2009, 2009 Agile Conference.

[5]  Austen Rainer,et al.  Defining a Requirements Process Improvement Model , 2005, Software Quality Journal.

[6]  C. Meyer,et al.  A Case in Case Study Methodology , 2001 .

[7]  Mark C. Paulk,et al.  How ISO 9001 Compares With The CMM , 1995, IEEE Softw..

[8]  Alec Dorling,et al.  SPICE: Software Process Improvement and Capability Determination , 1993, Software Quality Journal.

[9]  H. Simon,et al.  The sciences of the artificial (3rd ed.) , 1996 .

[10]  Tony Gorschek,et al.  A systematic review of domain analysis solutions for product lines , 2009, J. Syst. Softw..

[11]  D. Teece,et al.  DYNAMIC CAPABILITIES AND STRATEGIC MANAGEMENT , 1997 .

[12]  Tony Gorschek,et al.  A practitioner's guide to light weight software process assessment and improvement planning , 2008, J. Syst. Softw..

[13]  M. Marshall Sampling for qualitative research. , 1996, Family practice.

[14]  P. Kotler Marketing Management: Analysis, Planning, Implementation and Control , 1972 .

[15]  Björn Regnell,et al.  Market-Driven Requirements Engineering for Software Products , 2005 .

[16]  Deb Jacobs Requirements Engineering so Things Don't Get Ugly , 2007, 29th International Conference on Software Engineering (ICSE'07 Companion).

[17]  Pär Carlshamre,et al.  Release Planning in Market-Driven Software Product Development: Provoking an Understanding , 2002, Requirements Engineering.

[18]  Mario Jino,et al.  Analysis of an Artifact Oriented Test Process Model and of Testing Aspects of CMMI , 2006, PROFES.

[19]  George Stalk,et al.  Perspectives on strategy : from the Boston Consulting Group , 1998 .

[20]  Horst Lichter,et al.  A Cost-Based Approach to Software Product Line Management , 2006, 2006 International Workshop on Software Product Management (IWSPM'06 - RE'06 Workshop).

[21]  Inge van de Weerd,et al.  Concepts for Incremental Method Evolution: Empirical Exploration and Validation in Requirements Management , 2007, CAiSE.

[22]  Richard Barker,et al.  CASE method fast-track - a RAD approach , 1994 .

[23]  Jan Bosch,et al.  Maturity and Evolution in Software Product Lines: Approaches, Artefacts and Organization , 2002, SPLC.

[24]  Alain Abran,et al.  Guide to the Software Engineering Body of Knowledge : 2004 Version , 2005 .

[25]  Lloyd L. Byars,et al.  Strategic management : formulation and implementation : concepts and cases , 1991 .

[26]  Bashar Nuseibeh,et al.  Requirements engineering: a roadmap , 2000, ICSE '00.

[27]  Marjo Kauppinen,et al.  Linking the business view to requirements engineering: long-term product planning by roadmapping , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[28]  Inge van de Weerd,et al.  A Situational Assessment Method for Software Product Management , 2010, ECIS.

[29]  Tony Gorschek,et al.  Introduction of a process maturity model for market‐driven product management and requirements engineering , 2012, J. Softw. Maintenance Res. Pract..

[30]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[31]  Khaled El Emam,et al.  Does Organizational Maturity Improve Quality? , 1996, IEEE Softw..

[32]  Lai Xu,et al.  Concepts of product software , 2007, Eur. J. Inf. Syst..

[33]  Robert Winter Design Solution Analysis for the Construction of Situational Design Methods , 2011, ME.

[34]  Inge van de Weerd,et al.  Evaluating the Software Product Management Maturity Matrix , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[35]  Inge van de Weerd,et al.  The Influence of Situational Factors in Software Product Management: An Empirical Study , 2008, 2008 Second International Workshop on Software Product Management.

[36]  L. Krzanik,et al.  Is my software process improvement suitable for incremental deployment? , 1997, Proceedings Eighth IEEE International Workshop on Software Technology and Engineering Practice incorporating Computer Aided Software Engineering.

[37]  Susan A. Brown,et al.  Influence of System, Environment, and Procedures on Knowledge Submission Frequency , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[38]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[39]  Inge van de Weerd,et al.  The Online Method Engine: From Process Assessment to Method Execution , 2011, ME.

[40]  Christoph Zott,et al.  DYNAMIC CAPABILITIES AND THE EMERGENCE OF INTRAINDUSTRY DIFFERENTIAL FIRM PERFORMANCE: INSIGHTS FROM A SIMULATION STUDY , 2003 .

[41]  Raymond Dion,et al.  Process improvement and the corporate balance sheet , 1993, IEEE Software.

[42]  Watts S. Humphrey,et al.  Characterizing the software process: a maturity framework , 1988, IEEE Software.

[43]  Des Greer,et al.  Software release planning: an evolutionary and iterative approach , 2004, Inf. Softw. Technol..

[44]  Constance E. Helfat,et al.  The dynamic resource-based view: capability lifecycles , 2003 .

[45]  Maurizio Zollo,et al.  Deliberate Learning and the Evolution of Dynamic Capabilities , 2002 .

[46]  Sandeep Purao,et al.  Design Research in the Technology of Information Systems: Truth or Dare , 2002 .

[47]  Kathleen M. Eisenhardt,et al.  DYNAMIC CAPABILITIES, WHAT ARE THEY? , 2000 .

[48]  Marlies van Steenbergen,et al.  The Dynamic Architecture Maturity Matrix: Instrument Analysis and Refinement , 2009, ICSOC/ServiceWave Workshops.

[49]  Tony Gorschek,et al.  A method for alignment evaluation of product strategies among stakeholders (MASS) in software intensive product development , 2011, J. Softw. Maintenance Res. Pract..

[50]  Christof Ebert,et al.  The impacts of software product management , 2007, J. Syst. Softw..

[51]  S. Dasgupta Technology and Creativity , 2006, Woman with a Movie Camera.

[52]  Diane L. Gibson,et al.  Performance Results of CMMI ® -Based Process Improvement , 2006 .

[53]  Marco Iansiti,et al.  Intellectual Property, Architecture, and the Management of Technological Transitions: Evidence from Microsoft Corporation , 2009 .

[54]  Jonas Mellin,et al.  On the Testing Maturity of Software Producing Organizations , 2006, Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06).

[55]  Karl E. Wiegers,et al.  A Modular Software Process Mini-Assessment Method - Tool Report , 2000, IEEE Softw..

[56]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[57]  Lee G. Cooper Strategic Marketing Planning for Radically New Products , 2000 .

[58]  Sjaak Brinkkemper,et al.  Method engineering: engineering of information systems development methods and tools , 1996, Inf. Softw. Technol..

[59]  Jean-Pierre Kuilboer,et al.  Software process and product improvement: an empirical assessment , 2000, Inf. Softw. Technol..

[60]  Watts S. Humphrey,et al.  A method for assessing the software engineering capability of contractors , 1987 .

[61]  Inge van de Weerd,et al.  A Framework for Process Improvement in Software Product Management , 2010, EuroSPI.

[62]  Jan Dul,et al.  Case Study Methodology in Business Research , 2007 .

[63]  Rodina Binti Ahmad,et al.  Impact of cmmi-based process maturity levels on effort, productivity and diseconomy of scale , 2012, Int. Arab J. Inf. Technol..

[64]  K. Eisenhardt Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[65]  Robert Winter,et al.  Analysis of IT/Business Alignment Situations as a Precondition for the Design and Engineering of Situated IT/Business Alignment Solutions , 2011, 2011 44th Hawaii International Conference on System Sciences.

[66]  Marlies van Steenbergen,et al.  The Design of Focus Area Maturity Models , 2010, DESRIST.

[67]  Sjaak Brinkkemper,et al.  A product software knowledge infrastructure for situational capability maturation: Vision and case studies in product management , 2006 .

[68]  Inge van de Weerd,et al.  Developing a Maturity Matrix for Software Product Management , 2010, ICSOB.

[69]  Jos J. M. Trienekens,et al.  Specification of Service Level Agreements: Problems, Principles and Practices , 2004, Software Quality Journal.

[70]  Paul Clements,et al.  Software product lines - practices and patterns , 2001, SEI series in software engineering.

[71]  C. C. Snow,et al.  Measuring Organizational Strategies: Some Theoretical and Methodological Problems , 1980 .

[72]  Patrik Berander,et al.  Evolving Prioritization for Software Product Management , 2007 .

[73]  C. Fleisher,et al.  Strategic and Competitive Analysis: Methods and Techniques for Analyzing Business Competition , 2002 .

[74]  Catherine Blake Jaktman The influence of organisational factors on the success and quality of a product-line architecture , 1998, Proceedings 1998 Australian Software Engineering Conference (Cat. No.98EX233).

[75]  Karl E. Wiegers First Things First: Prioritizing Requirements , 1999 .

[76]  Thomas Birkhölzer,et al.  An interactive software management simulator based on the CMMI framework , 2005, Softw. Process. Improv. Pract..

[77]  Casper Lassenius,et al.  An Approach to Product Roadmapping in Small Software Product Businesses , 2002 .

[78]  Mark C. Paulk,et al.  Capability Maturity Model for Software , 2001 .

[79]  Slinger Jansen Customer Configuration Updating in a Software Supply Network. , 2007 .

[80]  N. Capon,et al.  Marketing and Technology: A Strategic Coalignment , 1987 .

[81]  Bradford K. Clark Quantifying the effects of process improvement on effort , 2000 .

[82]  Inge van de Weerd,et al.  Productization: Transforming from Developing Customer-Specific Software to Product Software , 2010, ICSOB.

[83]  Jan Bosch,et al.  On the notion of variability in software product lines , 2001, Proceedings Working IEEE/IFIP Conference on Software Architecture.

[84]  Manish Agrawal,et al.  Software Effort, Quality, and Cycle Time: A Study of CMM Level 5 Projects , 2007, IEEE Transactions on Software Engineering.

[85]  D. Teece,et al.  The Dynamic Capabilities of Firms: an Introduction , 1994 .

[86]  Inge van de Weerd,et al.  Incremental method evolution in global software product management: A retrospective case study , 2010, Inf. Softw. Technol..

[87]  Inge van de Weerd,et al.  On the Creation of a Reference Framework for Software Product Management: Validation and Tool Support , 2006, 2006 International Workshop on Software Product Management (IWSPM'06 - RE'06 Workshop).

[88]  Marlies van Steenbergen,et al.  An Instrument for the Development of the Enterprise Architecture Practice , 2007, ICEIS.

[89]  J. G. Brodman,et al.  What small businesses and small organizations say about the CMM , 1994, Proceedings of 16th International Conference on Software Engineering.

[90]  Xiaoqing Frank Liu,et al.  Business-oriented software process improvement based on CMMI using QFD , 2010, Inf. Softw. Technol..

[91]  Karlheinz Kautz,et al.  Applying and adjusting a software process improvement model in practice: the use of the IDEAL model in a small software enterprise , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[92]  Slinger Jansen,et al.  Shades of gray: Opening up a software producing organization with the open software enterprise model , 2012, J. Syst. Softw..

[93]  Marco R. Spruit,et al.  The Situational Assessment Method put to the test: Improvements based on case studies , 2010, 2010 Fourth International Workshop on Software Product Management.

[94]  K. Ulrich,et al.  Planning for Product Platforms , 1998 .

[95]  Marlies van Steenbergen,et al.  A Balanced Approach to Developing the Enterprise Architecture Practice , 2007, ICEIS.

[96]  D. Teece Explicating dynamic capabilities: the nature and microfoundations of (sustainable) enterprise performance , 2007 .

[97]  Mayuram S. Krishnan,et al.  Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development , 2000 .

[98]  Donald J Reifer The CMMI: it's formidable , 2000, J. Syst. Softw..

[99]  Sami Zahran Software process improvement - practical guidelines for business success , 1998 .

[100]  Andy Field,et al.  Discovering statistics using SPSS, 2nd ed. , 2005 .

[101]  Jackie Fenn,et al.  Mastering the Hype Cycle: How to Choose the Right Innovation at the Right Time , 2008 .