Effective Software Project Management Education through Simulation Models: An Externally Replicated Experiment

It is an undeniable fact that software project managers need reliable techniques and robust tool support to be able to exercise a fine control over the development process so that products can be delivered in time and within budget. Therefore, managers need to be trained so that they could learn and use new techniques and be aware of their possible impacts. In this context, effective learning is an issue. A small number of empirical studies have been carried out to study the impact of software engineering education. One such study is by Pfahl et al [11] in which they have performed a controlled experiment to evaluate the learning effectiveness of using a process simulation model for educating computer science students in software project management. The experimental group applied a Systems Dynamics simulation model while the control group used the COCOMO model as a predictive tool for project planning. The results indicated that students using the simulation model gain a better understanding about typical behaviour patterns of software development projects. Experiments need to be externally replicated to both verify and generalise original results. In this paper, we will discuss an externally replicated experiment in which we keep the design and the goal of the above experiment intact. We then analyse our results in relation to the original experiment and another externally replicated experiment, discussed in [12].

[1]  M. I. Kellner,et al.  Software process modeling: a case study , 1989, [1989] Proceedings of the Twenty-Second Annual Hawaii International Conference on System Sciences. Volume II: Software Track.

[2]  Dietmar Pfahl,et al.  A CBT module with integrated simulation component for software project management education and training , 2001, J. Syst. Softw..

[3]  Christian Bierwirth,et al.  Principles of Systems , 2000 .

[4]  Dietmar Pfahl,et al.  An Externally Replicated Experiment for Evaluating the Learning Effectiveness of Using Simulations in Software Project Management Education , 2003, Empirical Software Engineering.

[5]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[6]  Dietmar Pfahl,et al.  An experiment for evaluating the effectiveness of using a system dynamics simulation model in software project management education , 2001, Proceedings Seventh International Software Metrics Symposium.

[7]  BryantA.,et al.  B. W. Boehm software engineering economics , 1983 .

[8]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[9]  Stuart E. Madnick,et al.  Software Project Dynamics: An Integrated Approach , 1991 .

[10]  John D. W. Morecroft,et al.  System dynamics and microworlds for policymakers , 1988 .

[11]  Jeffrey C. Carver,et al.  Replicating software engineering experiments: addressing the tacit knowledge problem , 2002, Proceedings International Symposium on Empirical Software Engineering.

[12]  James Miller,et al.  Applying meta-analytical procedures to software engineering experiments , 2000, J. Syst. Softw..

[13]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[14]  George P. Richardson,et al.  Introduction to System Dynamics Modeling with DYNAMO , 1981 .