A Controlled Experiment for the Assessment of Aspects - Tracing in an Industrial Context

For years the Aspect Oriented Software Development community has promoted aspects as a solution to complexities introduced by implementing crosscutting concerns. And while a lot of research focuses on advancing the state of the art of aspect oriented programing and design, there is still no (reported) wide-spread industrial adoption of Aspect Oriented Programming. In this paper we report on an experiment to quantify the aspect-based approach to Tracing. The experiment was performed in an industrial setting at ASML. We believe that the example is a stereotypical aspect-oriented problem and as such the results of this experiment are very likely generalizable to other aspects. Participants of the experiment were requested to carry out five simple maintenance scenarios, related to Tracing. The result of this experiment demonstrates 6% and 77% reduction in development effort and errors, respectively. The statistical significance analysis has confirmed these reductions for a subset of the individual scenarios.

[1]  R van Engelen,et al.  Ideals : evolvability of software-intensive high-tech systems : a collaborative research project on maintaining complex embedded systems , 2007 .

[2]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[3]  Andrew Clement,et al.  Large-scale AOSD for middleware , 2004, AOSD '04.

[4]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2000, The Kluwer International Series in Software Engineering.

[5]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[6]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[7]  Amela Karahasanovic,et al.  A survey of controlled experiments in software engineering , 2005, IEEE Transactions on Software Engineering.

[8]  Robert J. Walker,et al.  An initial assessment of aspect-oriented programming , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[9]  Mehmet Aksit,et al.  Applying AOP in an Industrial Context: An Experience Paper , 2006 .

[10]  Robert J. Walker,et al.  Evaluating Emerging Software Development Technologies: Lessons Learned from Assessing Aspect-Oriented Programming , 1999, IEEE Trans. Software Eng..

[11]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[12]  Gregor Kiczales,et al.  RG: A Case-Study for Aspect-Oriented Programming , 1997 .

[13]  Remco van Engelen,et al.  An overview of Mirjam and WeaveC , 2007 .

[14]  Uwe Hohenstein,et al.  How to Convince Industry of AOP , 2007 .

[15]  Pascal Durr,et al.  Resource-based Verification for Robust Composition of Aspects , 2008 .