Exploiting organizational knowledge in developing IS project cost and schedule estimates: An empirical study

Project management is vital to the effective application of organizational resources to competing demands within and across projects. The effective application of project management, however, is predicated upon accurate estimates of the project budget and schedule. This study assesses primary and supporting activities that exploit knowledge within an organization's memory to develop project schedule durations and budgets. The study further assesses the subsequent impact of predictability on project success. Two hundred and sixteen survey responses from IT professionals with project management responsibilities were analyzed. Results found use of the primary activities of using parametric estimating techniques (use of formal models), bottom-up estimating techniques (formulating estimates at the task level), and the support activities of team reliance, realistic targets, and professional experience all impact the predictability of estimates for project cost and duration. Predictability in turn was found to directly impact project success with regards to meeting cost and duration objectives. While use of analogous estimating techniques (using similar previous projects) was not found to be useful for project managers with more experience, it was used by project managers with less experience in determining predictability.

[1]  Daniel Robey,et al.  Research Report - Modeling Interpersonal Processes During System Development: Further Thoughts and Suggestions , 1994, Inf. Syst. Res..

[2]  Albert L. Lederer,et al.  Nine management guidelines for better cost estimating , 1992, CACM.

[3]  Paul H. Cheney,et al.  A Theoretically Grounded Approach to Assist Memory Recall During Information Requirements Determination , 1998, J. Manag. Inf. Syst..

[4]  Dorothy E. Leidner,et al.  Knowledge Management Systems: Issues, Challenges, and Benefits , 1999, Commun. Assoc. Inf. Syst..

[5]  Kathy Brittain White,et al.  Information Systems Development Success: Perspectives from Project Team Participants , 1986, MIS Q..

[6]  D. Ross Jeffery,et al.  A Comparison of Function Point Counting Techniques , 1993, IEEE Trans. Software Eng..

[7]  Scott Shane,et al.  Fostering Risk Taking in Research and Development: The Importance of a Project's Terminal Value , 1998 .

[8]  Rudy Hirschheim,et al.  Realizing Emancipatory Principles in Information Systems Development: The Case for ETHICS , 1994, MIS Q..

[9]  Iris Vessey,et al.  Learning to Specify Information Requirements: The Relationship between Application and Methodology , 1993, J. Manag. Inf. Syst..

[10]  Stuart E. Madnick,et al.  Evolution towards Strategic Applications of Databases through Composite Information Systems , 1988, J. Manag. Inf. Syst..

[11]  Wanda J. Orlikowski,et al.  CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development , 1993, MIS Q..

[12]  Qing Hu,et al.  Software Cost Estimation Using Economic Production Models , 1998, J. Manag. Inf. Syst..

[13]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[14]  Boulevard de Constance,et al.  On Uncertainty, Ambiguity, and Complexity in Project Management , 2002 .

[15]  W. Duncan A GUIDE TO THE PROJECT MANAGEMENT BODY OF KNOWLEDGE , 1996 .

[16]  Rajiv Sabherwal,et al.  Determinants of Commitment to Information Systems Development: A Longitudinal Investigation , 1996, MIS Q..

[17]  James Kohnen,et al.  Creating the Project Office: A Manager's Guide to Leading Organizational Change , 2004 .

[18]  Henri Barki,et al.  User Participation, Conflict, and Conflict Resolution: The Mediating Roles of Influence , 1994, Inf. Syst. Res..

[19]  R. A. Cooke,et al.  Teamwork in planning innovative projects: improving group performance by rational and interpersonal interventions in group process , 1990 .

[20]  Magne Jørgensen Realism in assessment of effort estimation uncertainty: it matters how you ask , 2004, IEEE Transactions on Software Engineering.

[21]  Stephanie D. Teasley,et al.  Rapid Software Development through Team Collocation , 2002, IEEE Trans. Software Eng..

[22]  Niv Ahituv,et al.  A Flexible Approach to Information Systems Developmoent , 1984, MIS Q..

[23]  Bill Curtis,et al.  A field study of the software design process for large systems , 1988, CACM.

[24]  Mark Weiser,et al.  Project Memory: Information Management for Project Teams , 1998, J. Manag. Inf. Syst..

[25]  J. Pinto,et al.  Antecedents and consequences of project team cross-functional cooperation , 1993 .

[26]  Joerg Evermann,et al.  Toward formalizing domain modeling semantics in language syntax , 2005, IEEE Transactions on Software Engineering.

[27]  L. Sproull,et al.  Coordinating Expertise in Software Development Teams , 2000 .

[28]  Ding Zu-hao,et al.  On the Uncertainty , 2004 .

[29]  James E. Hunton,et al.  Effects of User Participation in Systems Development: A Longitudinal Field Experiment , 1997, MIS Q..

[30]  Edward Edward Yourdon,et al.  Death March: The Complete Software Developer's Guide to Surviving Mission Impossible Projects , 1999 .

[31]  Naveed Saleem,et al.  An Empirical Test of the Contingency Approach to User Participation in Information Systems Development , 1996, J. Manag. Inf. Syst..

[32]  Suku Nair,et al.  A Model for Software Development Effort and Cost Estimation , 1997, IEEE Trans. Software Eng..

[33]  Yoris A. Au Design Science I: The Role of Design Science in Electronic Commerce Research , 2001, Commun. Assoc. Inf. Syst..

[34]  Henri Barki,et al.  Rethinking the Concept of User Involvement , 1989, MIS Q..

[35]  U Dave,et al.  Critical Chain , 1998, J. Oper. Res. Soc..

[36]  Jan Stage,et al.  Controlling Prototype Development Through Risk Analysis , 1996, MIS Q..

[37]  Alan Howard On site: Software engineering project management , 2001, CACM.

[38]  Stephanie Watts Sussman,et al.  Understanding Strategic Learning: Linking Organizational Learning, Knowledge Management, and Sensemaking , 2001 .

[39]  Girish H. Subramanian,et al.  An Examination of Some Software Development Effort and Productivity Determinants in ICASE Tool Projects , 1996, J. Manag. Inf. Syst..

[40]  C HendersonJohn,et al.  Understanding "Strategic Learning" , 2001 .

[41]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[42]  C. Fornell A Second generation of multivariate analysis : classification of methods and implications for marketing research , 1985 .

[43]  Suzanne Rivard,et al.  An Integrative Contingency Model of Software Project Risk Management , 2001, J. Manag. Inf. Syst..

[44]  Thiagarajan Ravichandran,et al.  Swiftness and Intensity of Administrative Innovation Adoption: An Empirical Study of TQM in Information Systems , 2000, Decis. Sci..

[45]  Nader B. Ebrahimi,et al.  How to Improve the Calibration of Cost Models , 1999, IEEE Trans. Software Eng..

[46]  Ritu Agarwal,et al.  Cognitive Fit in Requirements Modeling: A Study of Object and Process Methodologies , 1996, J. Manag. Inf. Syst..

[47]  Izak Benbasat,et al.  Programmer and Analyst Time/Cost Estimation , 1980, MIS Q..

[48]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[49]  Robert C. Ford,et al.  Successful project teams: a study of MIS managers , 1992 .

[50]  Thiagarajan Ravichandran,et al.  Quality Management in Systems Development: An Organizational System Perspective , 2000, MIS Q..

[51]  Henri Barki,et al.  Measuring User Participation, User Involvement, and User Attitude , 1994, MIS Q..

[52]  J. Swan,et al.  Embedding New Management Knowledge in Project-Based Organizations , 2004 .

[53]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[54]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[55]  Barry W. Boehm,et al.  Disaggregating and Calibrating the CASE Tool Variable in COCOMO II , 2002, IEEE Trans. Software Eng..

[56]  Michael J. Prietula,et al.  Software-Effort Estimation: An Exploratory Study of Expert Performance , 1991, Inf. Syst. Res..

[57]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[58]  Rajesh Nellore,et al.  Factors influencing success in integrated product development (IPD) projects , 2001, IEEE Trans. Engineering Management.

[59]  Iris Vessey,et al.  CASE tools as collaborative support technologies , 1995, CACM.

[60]  Mark Gershon,et al.  The Selection of Computer‐Aided Software Engineering Tools: A Multi‐Criteria Decision Making Approach , 1991 .

[61]  William H. Ett,et al.  Lessons learned from a software process modeling system , 1992, CACM.

[62]  Weidong Xia,et al.  Complexity of Information Systems Development Projects: Conceptualization and Measurement Development , 2005, J. Manag. Inf. Syst..

[63]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[64]  Jean Couillard,et al.  Assessing and controlling the quality of a project end product: the earned quality method , 2000, IEEE Trans. Engineering Management.

[65]  Varun Grover,et al.  General Perspectives on Knowledge Management: Fostering a Research Agenda , 2001, J. Manag. Inf. Syst..

[66]  Stuart E. Madnick,et al.  Lessons learned from modeling the dynamics of software development , 1989, CACM.

[67]  Detmar W. Straub,et al.  A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example , 2005, Commun. Assoc. Inf. Syst..

[68]  Kweku Ewusi-Mensah,et al.  Critical issues in abandoned information systems development projects , 1997, CACM.

[69]  Russell L. Purvis,et al.  Project Management under Uncertainty: The Impact of Heuristics and Biases , 2002 .

[70]  Adel M. Aladwani An Integrated Performance Model of Information Systems Projects , 2002, J. Manag. Inf. Syst..

[71]  Mark Keil,et al.  Pulling the Plug: Software Project Management and the Problem of Project Escalation , 1995, MIS Q..

[72]  Mohan V. Tatikonda,et al.  Technology novelty, project complexity, and product development project execution success: a deeper look at task uncertainty in product innovation , 2000, IEEE Trans. Engineering Management.

[73]  Rudy Hirschheim,et al.  Four paradigms of information systems development , 1989, CACM.

[74]  Dorothy E. Leidner,et al.  Studying Knowledge Management in Information Systems Resarch: Discourses and Theoretical Assumptions , 2002, MIS Q..

[75]  Albert L. Lederer,et al.  Information system cost estimating: a management perspective , 1990 .

[76]  David Gefen,et al.  Structural Equation Modeling Techniques and Regression: Guidelines for Research Practice , 2000 .

[77]  David G. Novick,et al.  Participatory conversation in PD , 1993, CACM.

[78]  Jill Smith Slater,et al.  SIM Paper Competition: The Application Software Factory: Applying Total Quality Techniques to Systems Development , 1991, MIS Q..

[79]  Michael J. Muller,et al.  “Equal opportunity” PD using PICTIVE , 1993, CACM.

[80]  Tridas Mukhopadhyay,et al.  Software Processes and Project Performance , 1995, J. Manag. Inf. Syst..

[81]  Mark Keil,et al.  Turning Around Troubled Software Projects: An Exploratory Study of the Deescalation of Commitment to Failing Courses of Action , 1999, J. Manag. Inf. Syst..

[82]  John Moriarty,et al.  System Development Quality Control , 1978, MIS Q..

[83]  Daniel Robey,et al.  Perceptions of Conflict and Success in Information Systems Development Projects , 1993, J. Manag. Inf. Syst..

[84]  Roy Rada,et al.  Sharing standards: standardizing software projects , 2000, CACM.

[85]  Kishore Sengupta,et al.  The Impact of Goals On Software Project Management: An Experimental Investigation , 1999, MIS Q..

[86]  Iris Vessey,et al.  Requirements specification: learning object, process, and data methodologies , 1994, CACM.

[87]  Rudy Hirschheim,et al.  A Paradigmatic Analysis Contrasting Information Systems Development Approaches and Methodologies , 1998, Inf. Syst. Res..

[88]  Alan Howard Software engineering project management. , 2001 .

[89]  O. Hauptman,et al.  The influence of process concurrency on project outcomes in product development: an empirical study of cross-functional teams , 1996 .

[90]  Chris F. Kemerer,et al.  Improving the Reliability of Function Point Measurement: An Empirical Study , 1992, IEEE Trans. Software Eng..

[91]  Randall L. Englund,et al.  Creating the Project Office: A Manager's Guide to Leading Organizational Change , 2003 .

[92]  Paul H. Cheney,et al.  The Effects of Information Technology Project Complexity on Group Interaction , 2004, J. Manag. Inf. Syst..

[93]  Effy Oz,et al.  When professional standards are lax: the CONFIRM failure and its lessons , 1994, CACM.

[94]  Suzanne Rivard,et al.  Toward an Assessment of Software Development Risk , 1993, J. Manag. Inf. Syst..

[95]  John F. S. Bunch Connecting The Dots: Aligning Projects with Objectives in Unpredictable Times , 2003 .

[96]  Gary Knotts,et al.  The Effects of Customizability and Reusability on Perceived Process and Competitive Performance of Software Firms , 1998, MIS Q..

[97]  Shin Ta Liu,et al.  Project Management: A Systems Approach To Planning, Scheduling and Controlling (Book) , 2004 .

[98]  Jay F. Nunamaker,et al.  CASE productivity perceptions of software engineering professionals , 1989, CACM.

[99]  M. Keil,et al.  The effects of sunk cost and project completion on information technology project escalation , 1995 .

[100]  C. R. Franz,et al.  Group process and conflict in system development , 1989 .