Contributions and Perspectives in Architectures of Software Testing Environments

Producing high quality software systems has been one of the most important software development concerns. In this perspective, Software Architecture and Software Testing are two important research areas that have contributed in that direction. The attention given to the software architecture has played a significant role in determining the success of software systems. Otherwise, software testing has been recognized as a fundamental activity for assuring the software quality; however, it is an expensive, error-prone, and time consuming activity. For this reason, a diversity of testing tools and environments has been developed; however, they have been almost always designed without an adequate attention to their evolution, maintenance, reuse, and mainly to their architectures. Thus, this paper presents our main contributions to systematize the development of testing tools and environments, aiming at improving their quality, reuse, and productivity. In particular, we have addressed architectures for software testing tools and environments and have also developed and made available testing tools. We also state perspectives of research in this area, including open research issues that must be treated, considering the unquestionable relevance of testing automation to the testing activity.

[1]  Fabiano Cutigi Ferrari,et al.  Towards a Reference Architecture for Software Testing Tools , 2007, SEKE.

[2]  Mary Jean Harrold,et al.  Testing: a roadmap , 2000, ICSE '00.

[3]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[4]  Debra J. Richardson,et al.  An evaluation of software test environment architectures , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[5]  Peter Sommerlad,et al.  Pattern-Oriented Software Architecture Volume 1: A System of Patterns , 1996 .

[6]  Eda Marchetti,et al.  Introducing service-oriented coverage testing , 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering - Workshops.

[7]  Francis G. McCabe,et al.  Reference Model for Service Oriented Architecture 1.0 , 2006 .

[8]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[9]  Brian P. Gallagher,et al.  Using the Architecture Tradeoff Analysis Method SM to Evaluate a Reference Architecture: A Case Study , 2000 .

[10]  J. Z. Gao,et al.  Developing an integrated testing environment using the World Wide Web technology , 1997, Proceedings Twenty-First Annual International Computer Software and Applications Conference (COMPSAC'97).

[11]  B. J. Ferro Castro,et al.  Pattern-Oriented Software Architecture: A System of Patterns , 2009 .

[12]  Delano M. Beder,et al.  JaBUTiService: A Web Service for Structural Testing of Java Programs , 2009, 2009 33rd Annual IEEE Software Engineering Workshop.

[13]  Elisa Yumi Nakagawa,et al.  Exploring ontologies to support the establishment of reference architectures: An example on software testing , 2009, 2009 Joint Working IEEE/IFIP Conference on Software Architecture & European Conference on Software Architecture.

[14]  Mary Shaw,et al.  The golden age of software architecture , 2006, IEEE Software.

[15]  Fabiano Cutigi Ferrari,et al.  Automating the mutation testing of aspect-oriented Java programs , 2010, AST '10.

[16]  Roger J. Martin,et al.  Reference Model for Frameworks of Software Engineering Environments (Technical Report ECMA TR/55, 2nd Edition) | NIST , 1991 .

[17]  David Garlan,et al.  Software architecture: a roadmap , 2000, ICSE '00.

[18]  A. Jefferson Offutt,et al.  MuJava: a mutation system for java , 2006, ICSE.

[19]  Fabiano Cutigi Ferrari,et al.  An aspect-oriented reference architecture for Software Engineering Environments , 2011, J. Syst. Softw..

[20]  Mike P. Papazoglou,et al.  Service oriented architectures: approaches, technologies and research issues , 2007, The VLDB Journal.

[21]  M.L. Soffa,et al.  Demand-driven structural testing with dynamic instrumentation , 2005, Proceedings. 27th International Conference on Software Engineering, 2005. ICSE 2005..

[22]  K. K. Aggarwal,et al.  A dynamic software metric and debugging tool , 2003, SOEN.

[23]  Elisa Yumi Nakagawa,et al.  Ontology-based Development of Testing Related Tools , 2008, SEKE.

[24]  Elisa Yumi Nakagawa,et al.  Towards a process to design aspect-oriented reference architectures , 2009 .

[25]  David Garlan,et al.  Documenting software architectures: views and beyond , 2002, 25th International Conference on Software Engineering, 2003. Proceedings..

[26]  William C. Chu,et al.  An object-oriented architecture supporting Web application testing , 1999, Proceedings. Twenty-Third Annual International Computer Software and Applications Conference (Cat. No.99CB37032).

[27]  Auri Marcelo Rizzo Vincenzi,et al.  Muta-Pro: Towards the definition of a mutation testing process , 2006, Journal of the Brazilian Computer Society.

[28]  Liang-Jie Zhang,et al.  S3: A Service-Oriented Reference Architecture , 2007, IT Professional.

[29]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[30]  Philippe Kruchten,et al.  The Past, Present, and Future for Software Architecture , 2006, IEEE Software.

[31]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[32]  Zhang You-Sheng,et al.  Architecture-based SW process model , 2003, SOEN.

[33]  Elisa Yumi Nakagawa,et al.  Software Configuration Management as a Crosscutting Concern: An Example on Software Testing , 2010, SEKE.

[34]  Paul W. P. J. Grefen,et al.  Towards a Method for the Evaluation of Reference Architectures: Experiences from a Case , 2008, ECSA.

[35]  Elisa Yumi Nakagawa,et al.  Reference Architecture and Product Line Architecture: A Subtle But Critical Difference , 2011, ECSA.

[36]  Auri Marcelo Rizzo Vincenzi,et al.  Proteum: a family of tools to support specification and program testing based on mutation , 2001 .

[37]  Aditya P. Mathur,et al.  Interface Mutation: An Approach for Integration Testing , 2001, IEEE Trans. Software Eng..

[38]  Guylain Delmas,et al.  Plot monitoring for interactive narrative games , 2007, ACE '07.

[39]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.