Evaluating a rapid simulation modelling process (RSMP) through controlled experiments

In recent years there has been an increasing interest in simulation modelling to study, control, and manage software development processes. Despite this, little attention has been paid towards the simulation modelling process itself. We have developed a rapid simulation modelling process (RSMP) based on our study of experienced simulation modellers. This paper reports a set of controlled experiments to evaluate the usability and utility of the RSMP. The results from this show that the RSMP has proved to be a usable and useful approach for developing software process simulation models. The results show that the RSMP is likely to bring discipline to software process simulation modellers and improve the quality of the model they produce.

[1]  Thomas R. Willemain,et al.  Insights on Modeling from a Dozen Experts , 1994, Oper. Res..

[2]  Dietmar Pfahl,et al.  IMMoS: a methodology for integrated measurement, modelling and simulation , 2002, Softw. Process. Improv. Pract..

[3]  W. Neuman,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2002 .

[4]  David Raffo,et al.  Empirical analysis in software process simulation modeling , 2000, J. Syst. Softw..

[5]  Osman Balci,et al.  Requirements for model development environments , 1986, Comput. Oper. Res..

[6]  D. M. Eriksson,et al.  A framework for the constitution of modelling processes: A proposition , 2003, Eur. J. Oper. Res..

[7]  Roger J. Brooks,et al.  Choosing the best model: Level of detail, complexity, and model performance , 1996 .

[8]  Paul F. Roth,et al.  Some considerations for improving federal modeling , 1978, WSC '78.

[9]  Stewart Robinson,et al.  Simulation modelling practices of ProSim03 participants: A survey , 2004, ICSE 2004.

[10]  Raymond J. Madachy,et al.  Software process simulation modeling: Why? What? How? , 1999, J. Syst. Softw..

[11]  Saul I. Gass,et al.  Feature Article - Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis , 1983, Oper. Res..

[12]  V. B. Misic.  Extreme dynamics: towards a system dynamics model of the extreme programming software development process , 2004, ICSE 2004.

[13]  Saul I. Gass,et al.  Managing the modeling process: a personal reflection , 1987 .

[14]  Saul I. Gass,et al.  Concepts of model confidence , 1981, Comput. Oper. Res..