Test Suite Comprehension for Modular and Dynamic Systems

The two main topics of this dissertation are plug-in-based systems and test suite comprehension. In particular, challenges during testing plug-in-based systems are revealed, and reverse engineering based techniques to support developers during test suite comprehension are presented.

[1]  Ileana Buhan,et al.  Cryptographic keys from noisy data, theory and applications , 2008 .

[2]  Tingting Han,et al.  Diagnosis, Synthesis and Analysis of Probabilistic Models , 2009, Ausgezeichnete Informatikdissertationen.

[3]  Jens R. Calamé,et al.  Testing reactive systems with data: enumerative methods and constraint solving , 2008 .

[4]  R. Boumen,et al.  Integration and test plans for complex manufacturing systems , 2007 .

[5]  de A. Bruin,et al.  Service-oriented discovery of knowledge : foundations, implementations and applications , 2010 .

[6]  Paul C. Jorgensen,et al.  Object-oriented integration testing , 1994, CACM.

[7]  Charles Ashbacher.  Growing Object-Oriented Software, Guided by Tests , 2010, J. Object Technol..

[8]  Klaus Pohl,et al.  Integration Testing in Software Product Line Engineering: A Model-Based Technique , 2007, FASE.

[9]  Martijn van Veelen,et al.  Considerations on modeling for early detection of abnormalities in locally autonomous distributed systems , 2007 .

[10]  Juan Fernández-Ramil,et al.  The evolution of Eclipse , 2008, 2008 IEEE International Conference on Software Maintenance.

[11]  Graham A. Stephen.  String Searching Algorithms , 1994, Lecture Notes Series on Computing.

[12]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[13]  B. J. Arnoldus,et al.  An illumination of the template enigma : software code generation with templates , 2011 .

[14]  Jonathan I. Maletic,et al.  Journal of Software Maintenance and Evolution: Research and Practice Survey a Survey and Taxonomy of Approaches for Mining Software Repositories in the Context of Software Evolution , 2022 .

[15]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[16]  Damiano Bolzoni,et al.  Revisiting Anomaly-based Network Intrusion Detection Systems , 2009 .

[17]  Gerard Meszaros,et al.  xUnit Test Patterns: Refactoring Test Code , 2007 .

[18]  Bas Basten,et al.  Ambiguity Detection for Programming Language Grammars , 2011 .

[19]  Ncwm Niels Braspenning.  Model-based integration and testing of high-tech multi-disciplinary systems , 2008 .

[20]  H. A. deJong.  Flexible Heterogeneous Software Systems , 2007 .

[21]  Tom Staijen,et al.  Graph-based Specification and Verification for Aspect-Oriented Languages , 2010 .

[22]  A. Morali,et al.  IT architecture-based confidentiality risk assessment in networks of organizations , 2011 .

[23]  M. T. de Berg,et al.  Algorithms for Fat Objects: Decompositions and Applications , 2004 .

[24]  S. Georgievska.  Probability and Hiding in Concurrent Processes ( thesis abstract ) , 2011 .

[25]  J. Endrullis.  Termination and Productivity , 2010 .

[26]  Leif Singer,et al.  Creating a shared understanding of testing culture on a social coding site , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[27]  Robert Brijder,et al.  Models of natural computation : gene assembly and membrane systems , 2008 .

[28]  Trajce Dimkov,et al.  Alignment of organizational security policies: Theory and Practice , 2012 .

[29]  Philippe Kruchten,et al.  Using grounded theory to study the experience of software development , 2011, Empirical Software Engineering.

[30]  M Muhammad Atif,et al.  Formal modeling and verification of distributed failure detectors , 2011 .

[31]  Georgeta Igna,et al.  Performance analysis of real-time task systems using timed automata , 2013 .

[32]  Arie van Deursen,et al.  Studying the co-evolution of production and test code in open source and industrial developer test processes through repository mining , 2008, Empirical Software Engineering.

[33]  van Pja Paul Tilburg.  From computability to executability : a process-theoretic view on automata theory , 2011 .

[34]  T. D. Vu,et al.  Semantics and applications of process and program algebra , 2007 .

[35]  Sebastián Uchitel,et al.  Predictable Dynamic Plugin Systems , 2004, FASE.

[36]  Mohammed G. Khatib.  MEMS-Based Storage Devices : Integration in Energy-Constrained Mobile Systems , 2009 .

[37]  Thomas Bäck,et al.  Mixed-integer evolution strategies for parameter optimization and their applications to medical image analysis , 2005 .

[38]  Bastiaan Stephan Graaf,et al.  Model-Driven Evolution of Software Architectures , 2007, 11th European Conference on Software Maintenance and Reengineering (CSMR'07).

[39]  V. Laz.  Faculty of Mathematics and Computer Science , 2011 .

[40]  Arie van Deursen,et al.  What your plug-in test suites really test: an integration perspective on test suite understanding , 2013, Empirical Software Engineering.

[41]  Lacramioara Astefanoaei,et al.  An executable theory of multi-agent systems refinement , 2011 .

[42]  van Mpwj Michiel Osch.  Automated model-based testing of hybrid systems , 2009 .

[43]  Robert C. Martin.  Clean Code - a Handbook of Agile Software Craftsmanship , 2008 .

[44]  W. Kuijper.  Compositional Synthesis of Safety Controllers , 2012 .

[45]  Anton Wijs,et al.  Silent steps in transition systems and Markov chains , 2007 .

[46]  H. Hansen.  Coalgebraic Modelling : Applications in Automata theory and Modal logic , 2009 .

[47]  Bart Van Rompaey,et al.  TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites , 2008 .

[48]  Emil Sekerinski,et al.  A Study of The Fragile Base Class Problem , 1998, ECOOP.

[49]  Arjen van Weelden,et al.  Putting Types To Good Use , 2007 .

[50]  Hendrik Michaël van der Bijl,et al.  On changing models in model-based testing , 2011 .

[51]  Hossein Rahmani,et al.  Analysis of protein-protein interaction networks by means of annotated graph mining algorithms , 2012 .

[52]  Anton Wijs,et al.  What to do next? Analysing and optimising system behaviour in time , 2007 .

[53]  Ljp Luc Engelen.  From napkin sketches to reliable software , 2012 .

[54]  A. Strauss,et al.  Grounded theory , 2017 .

[55]  Mari Antonius Cornelis Dekker,et al.  Flexible Access Control for Dynamic Collaborative Environments , 2009 .

[56]  Aah Ammar Osaiweran.  Formal development of control software in the medical systems domain , 2012 .

[57]  Mohammad Mahdi Jaghoori,et al.  Time At Your Service: Schedulability Analysis of Real-Time and Distributed Services , 2010 .

[58]  Mohammad Ali Abam.  New data structures and algorithms for mobile data , 2007 .

[59]  Robert V. Binder,et al.  Testing Object-Oriented Systems: Models, Patterns, and Tools , 1999 .

[60]  Scw Bas Ploeger,et al.  Improved verification methods for concurrent systems , 2009 .

[61]  Helmut Neukirchen,et al.  Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites , 2007, TestCom/FATES.

[62]  Yijun Yu,et al.  Analyzing the evolution of eclipse plugins , 2008, MSR '08.

[63]  Hasan Sözer,et al.  Architecting Fault-Tolerant Software Systems , 2009 .

[64]  Martin P. Robillard,et al.  Creating and evolving developer documentation: understanding the decisions of open source contributors , 2010, FSE '10.

[65]  Laura Brandán Briones,et al.  Theories for Model-based Testing: Real-time and Coverage , 2007 .

[66]  M. J. de Mol,et al.  Reasoning about functional programs : Sparkle, a proof assistant for Clean , 2009 .

[67]  Dennis B. Smith,et al.  Towards a framework for program understanding , 1996, WPC '96. 4th Workshop on Program Comprehension.

[68]  C. J. Boogerd,et al.  Focusing Automatic Code Inspections , 2010 .

[69]  Gregg Rothermel,et al.  Empirical Studies of a Safe Regression Test Selection Technique , 1998, IEEE Trans. Software Eng..

[70]  Evans,et al.  Domain-driven design , 2003 .

[71]  Tong Zhang,et al.  Text Mining: Predictive Methods for Analyzing Unstructured Information , 2004 .

[72]  Radu Marinescu,et al.  Detecting design flaws via metrics in object-oriented systems , 2001, Proceedings 39th International Conference and Exhibition on Technology of Object-Oriented Languages and Systems. TOOLS 39.

[73]  Markus Völter.  Pluggable Component: A Pattern for Interactive System Configuration , 1999, EuroPLoP.

[74]  Sebastiaan Gijsbert Marinus Cornelissen,et al.  Evaluating Dynamic Analysis Techniques for Program Comprehension , 2009 .

[75]  Adam A. Porter,et al.  Community-based, collaborative testing and analysis , 2010, FoSER '10.

[76]  Kent L. Beck,et al.  Test-driven Development - by example , 2002, The Addison-Wesley signature series.

[77]  Brian Henderson-Sellers,et al.  Object-Oriented Metrics , 1995, TOOLS.

[78]  Andy Zaidman,et al.  An assessmentmethodology for trace reduction techniques , 2008, 2008 IEEE International Conference on Software Maintenance.

[79]  J. Kwisthout,et al.  The Computational Complexity of Probabilistic Networks , 2009 .

[80]  Oscar Nierstrasz,et al.  Towards a Taxonomy of SUnit Tests , 2005, ESUG.

[81]  D. E. Nadales Agut,et al.  A Compositional Interchange Format for Hybrid Systems: Design and Implementation , 2012 .

[82]  Werner Heijstek,et al.  Architecture design in global and model-centric software development , 2012 .

[83]  Leonardo Mariani,et al.  Compatibility and Regression Testing of COTS-Component-Based Software , 2007, 29th International Conference on Software Engineering (ICSE'07).

[84]  Myra B. Cohen,et al.  Improving the Testing and Testability of Software Product Lines , 2010, SPLC.

[85]  Thomas A. Corbi,et al.  Program Understanding: Challenge for the 1990s , 1989, IBM Syst. J..

[86]  B. Van Rompaey,et al.  On The Detection of Test Smells: A Metrics-Based Approach for General Fixture and Eager Test , 2007, IEEE Transactions on Software Engineering.

[87]  Alessandro Orso,et al.  Understanding myths and realities of test-suite evolution , 2012, SIGSOFT FSE.

[88]  Oscar Nierstrasz,et al.  Object-oriented reengineering patterns , 2004, Proceedings. 26th International Conference on Software Engineering.

[89]  Sigrid Eldh.  Software Testing Techniques , 2007 .

[90]  Michele Lanza,et al.  Object-Oriented Metrics in Practice - Using Software Metrics to Characterize, Evaluate, and Improve the Design of Object-Oriented Systems , 2006 .

[91]  Young-Joo Moon,et al.  Stochastic models for quality of service of component connectors , 2011 .

[92]  Z Zvezdan Protic,et al.  Configuration management for models : generic methods for model comparison and model co-evolution , 2011 .

[93]  A. Rodriguez Yakushev,et al.  Towards Getting Generic Programming Ready for Prime Time , 2009 .

[94]  Mark Harman,et al.  Clustering test cases to achieve effective and scalable prioritisation incorporating expert knowledge , 2009, ISSTA.

[95]  Seyyed Hamed Hashemi,et al.  Studies on verification of wireless sensor networks and abstraction learning for system inference , 2008 .

[96]  Hugo Jonker,et al.  Security matters : privacy in voting and fairness in digital exchange , 2009 .

[97]  Barbara G. Ryder,et al.  Fragment class analysis for testing of polymorphism in Java software , 2004, IEEE Transactions on Software Engineering.

[98]  Henry Muccini,et al.  Towards Testing Product Line Architectures , 2003, TACoS.

[99]  Arie van Deursen,et al.  Automated Detection of Test Fixture Strategies and Smells , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation.

[100]  Oscar H. Ibarra,et al.  On spiking neural P systems , 2006, Natural Computing.

[101]  Joel West,et al.  The Role of Participation Architecture in Growing Sponsored Open Source Communities , 2008 .

[102]  Arie van Deursen,et al.  Measuring Test Case Similarity to Support Test Suite Understanding , 2012, TOOLS.

[103]  J. K. Berendsen,et al.  Abstraction, prices and probability in model checking timed automata , 2010 .

[104]  Harmen Kastenberg.  Graph-based software specification and verification , 2008 .

[105]  M. T. de Berg,et al.  Multi-functional geometric data structures , 2003 .

[106]  Michael W. Godfrey,et al.  Software process recovery using Recovered Unified Process Views , 2010, 2010 IEEE International Conference on Software Maintenance.

[107]  Oscar Nierstrasz,et al.  Ordering broken unit tests for focused debugging , 2004, 20th IEEE International Conference on Software Maintenance, 2004. Proceedings..

[108]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[109]  M. G. van der Horst,et al.  Scalable block processing algorithms , 2008 .

[110]  Dmitri Jarnikov,et al.  QoS framework for video streaming in home networks , 2007 .

[111]  Arie van Deursen,et al.  Understanding Plug-in Test Suites from an Extensibility Perspective , 2010, 2010 17th Working Conference on Reverse Engineering.

[112]  Eric S. Raymond,et al.  The cathedral and the bazaar - musings on Linux and Open Source by an accidental revolutionary , 2001 .

[113]  Arie van Deursen,et al.  Visualizing Testsuites to Aid in Software Understanding , 2006, 11th European Conference on Software Maintenance and Reengineering (CSMR'07).

[114]  Jean Hartmann,et al.  UML-Based integration testing , 2000, ISSTA '00.

[115]  Arie van Deursen,et al.  Refactoring test code , 2001 .

[116]  Stephanie Kemper,et al.  Modelling and analysis of real-time coordination patterns , 2011 .

[117]  Adriaan Middelkoop,et al.  Inference of Program Properties with Attribute Grammars, Revisited , 2012 .

[118]  K. Tsirogiannis,et al.  Analysis of flow and visibility on triangulated terrains , 2011 .

[119]  Nahid Golafshani,et al.  Understanding Reliability and Validity in Qualitative Research , 2003 .

[120]  Lennart C. L. Kats,et al.  Building Blocks for Language Workbenches , 2011 .

[121]  Arie van Deursen,et al.  Symphony: view-driven software architecture reconstruction , 2004, Proceedings. Fourth Working IEEE/IFIP Conference on Software Architecture (WICSA 2004).

[122]  Eu-Jin Goh,et al.  Searching on Encrypted Data , 2003 .

[123]  Uzma Raja,et al.  Antecedents of open source software defects: A data mining approach to model formulation, validation and testing , 2009, Inf. Technol. Manag..

[124]  E Elena Mumford,et al.  Drawing graphs for cartographic applications , 2008 .

[125]  Franz Schweiggert,et al.  Lightweight Plug-In-Based Application Development , 2002, NetObjectDays.

[126]  U Uzma Khadim,et al.  Process algebras for hybrid systems : comparison and development , 2008 .

[127]  Vahid Garousi,et al.  A replicated survey of software testing practices in the Canadian province of Alberta: What has changed from 2004 to 2009? , 2010, J. Syst. Softw..

[128]  Will G. Hopkins,et al.  A new view of statistics , 2002 .

[129]  Klaus Marquardt,et al.  Patterns for Plug-Ins , 1999, EuroPLoP.

[130]  EM Elena Bortnik,et al.  Formal methods in support of SMC design , 2008 .

[131]  Michael C. Feathers.  Working Effectively with Legacy Code , 2004, XP/Agile Universe.

[132]  Aad Mathssen,et al.  Logical Calculi for Reasoning with Binding , 2008 .

[133]  R.S.S. O'Connor,et al.  Incompleteness & completeness : formalizing logic and analysis in type theory , 2005 .

[134]  Marcel Verhoef,et al.  Modeling and validating distributed embedded real-time control systems , 2009 .

[135]  Cfj Christian Lange,et al.  Assessing and improving the quality of modeling : a series of empirical studies about the UML , 2007 .

[136]  Martin R. Neuhäußer,et al.  Model checking nondeterministic and randomly timed systems , 2010 .

[137]  Martin Bravenboer,et al.  Exercises in Free Syntax. Syntax Definition, Parsing, and Assimilation of Language Conglomerates , 2003 .

[138]  Flavio D. Garcia.  Formal and Computational Cryptography: Protocols, Hashes and Commitments , 2008 .

[139]  Meir M. Lehman,et al.  On understanding laws, evolution, and conservation in the large-program life cycle , 1984, J. Syst. Softw..

[140]  Fpm Frank Stappers.  Bridging formal models : an engineering perspective , 2012 .

[141]  van Mf Marcel Amstel,et al.  Assessing and improving the quality of model transformations , 2012 .

[142]  Arie van Deursen,et al.  Test confessions: A study of testing practices for plug-in systems , 2011, 2012 34th International Conference on Software Engineering (ICSE).

[143]  Arie van Deursen,et al.  Mining Software Repositories to Study Co-Evolution of Production & Test Code , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[144]  N. Leech,et al.  Validity and Qualitative Research: An Oxymoron? , 2007 .

[145]  Sungwon Kang,et al.  A survey on software product line testing , 2012, SPLC '12.

[146]  Jasen Markovski,et al.  Real and stochastic time in process algebras for performance evaluation , 2008 .

[147]  Raluca Marin-Perianu,et al.  Wireless Sensor Networks in Motion - Clustering Algorithms for Service Discovery and Provisioning , 2008 .

[148]  Arie van Deursen,et al.  A Systematic Survey of Program Comprehension through Dynamic Analysis , 2008, IEEE Transactions on Software Engineering.

[149]  Warren Harrison.  Eating Your Own Dog Food , 2006, IEEE Softw..

[150]  Somayeh Malakuti Khah Olun Abadi.  Event composition model: achieving naturalness in runtime enforcement , 2011 .

[151]  Farhad Arbab,et al.  Model Checking of Component Connectors , 2007, 31st Annual International Computer Software and Applications Conference (COMPSAC 2007).

[152]  Ronald Middelkoop,et al.  Capturing and exploiting abstract views of states in OO verification , 2011 .

[153]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[154]  RH Rudolf Mak,et al.  Design and performance analysis of data-independent stream processing systems , 2008 .

[155]  Karina R. Olmos Joffré.  Strategies for Context Sensitive Program Transformation , 2009 .

[156]  Arie van Deursen,et al.  Strategies for avoiding text fixture smells during software evolution , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[157]  Tim K. Cocx,et al.  Algorithmic tools for data-oriented law enforcement , 2009 .

[158]  Arie van Deursen,et al.  Supporting professional spreadsheet users by generating leveled dataflow diagrams , 2010, 2011 33rd International Conference on Software Engineering (ICSE).

[159]  Karim R. Lakhani,et al.  Community, Joining, and Specialization in Open Source Software Innovation: A Case Study , 2003 .

[160]  Adam A. Porter,et al.  Testing component compatibility in evolving configurations , 2013, Inf. Softw. Technol..

[161]  Miguel E. Andrés,et al.  Quantitative Analysis of Information Leakage in Probabilistic and Nondeterministic Systems , 2011, ArXiv.

[162]  Magiel Bruntink,et al.  Renovation of idiomatic crosscutting concerns in embedded systems , 2005 .

[163]  Zef Hemel.  Methods and Techniques for the Design and Implementation of Domain-Specific Languages , 2012 .

[164]  Kent Beck,et al.  Contributing to Eclipse - principles, patterns, and plug-ins , 2003, The Eclipse series.

[165]  Andy Zaidman,et al.  Evaluating the Lifespan of Code Smells using Software Repository Mining , 2012, 2012 16th European Conference on Software Maintenance and Reengineering.

[166]  Wolter Pieters,et al.  La volonté machinale: understanding the electronic voting controversy , 2008 .

[167]  Boris Beizer,et al.  Software testing techniques (2. ed.) , 1990 .

[168]  D. Graaf,et al.  Mining semi-structured data, theoretical and experimental aspects of pattern evaluation , 2008 .

[169]  Martin Kropp,et al.  Automated acceptance test refactoring , 2011, WRT '11.

[170]  Chris F. Kemerer,et al.  A Metrics Suite for Object Oriented Design , 2015, IEEE Trans. Software Eng..

[171]  Gürcan Gülesir,et al.  Evolvable Behavior Specifications Using Context-Sensitive Wildcards , 2008 .

[172]  J. van den Berg,et al.  Reasoning about Java programs in PVS using JML , 2009 .

[173]  Emmanuele Zambon,et al.  Towards optimal IT availability planning: methods and tools , 2011 .

[174]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.

[175]  Ivan S. Zapreev.  Model checking Markov chains : techniques and tools , 2008 .

[176]  Serge Demeyer,et al.  Characterizing the Relative Significance of a Test Smell , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[177]  Vahid Garousi,et al.  TeCReVis: A Tool for Test Coverage and Test Redundancy Visualization , 2010, TAIC PART.

[178]  de Ism Ivo Jong.  Integration and test strategies for complex manufacturing machines , 2008 .

[179]  Ichiro Hasuo,et al.  Tracing Anonymity with Coalgebras , 2008 .

[180]  Nikolay Kavaldjiev,et al.  A run-time reconfigurable Network-on-Chip for streaming DSP applications , 2006 .

[181]  Eduardo Zambon,et al.  Abstract Graph Transformation - Theory and Practice , 2013 .

[182]  Sallie M. Henry,et al.  Object-oriented metrics that predict maintainability , 1993, J. Syst. Softw..

[183]  Saeed Sedghi,et al.  Towards Provably Secure Efficiently Searchable Encryption , 2012 .

[184]  Klaus Pohl,et al.  Software product line testing , 2006, CACM.

[185]  Elaine J. Weyuker,et al.  Testing Component-Based Software: A Cautionary Tale , 1998, IEEE Softw..

[186]  José Proença,et al.  Synchronous Coordination of Distributed Components , 2011 .

[187]  B. Lijnse,et al.  TOP to the rescue. Task-oriented programming for incident response applications , 2005 .

[188]  K. Charmaz,et al.  The sage handbook of grounded theory , 2007 .

[189]  Andrea Polini,et al.  Testing software components for integration: a survey of issues and techniques , 2007, Softw. Test. Verification Reliab..

[190]  M. Torabi Dashti,et al.  Keeping Fairness Alive : Design and formal verification of optimistic fair exchange protocols , 2008 .

[191]  Yann-Gaël Guéhéneuc,et al.  DECOR: A Method for the Specification and Detection of Code and Design Smells , 2010, IEEE Transactions on Software Engineering.

[192]  Pascal Durr,et al.  Resource-based Verification for Robust Composition of Aspects , 2008 .

[193]  Iris Loeb.  Natural Deduction, Sharing By Presentation , 2007 .

[194]  A. L. de Groot,et al.  Practical Automaton proofs in PVS , 2000 .

[195]  Margaret-Anne D. Storey,et al.  Understanding broadcast based peer review on open source software projects , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[196]  J. Calder.  Survey research methods , 1998, Medical education.

[197]  Sherry Shavor,et al.  The Java Developer's Guide to Eclipse , 2003 .

[198]  R. Bakhshi.  Gossiping Models : Formal Analysis of Epidemic Protocols , 2011 .

[199]  Tim K. Cocx,et al.  Metrics and visualisation for crime analysis and genomics , 2005 .

[200]  T. van der Storm.  Component-based configuration, integration and delivery , 2003 .

[201]  Ali Mesbah,et al.  Analysis and Testing of Ajax-based Single-page Web Applications , 2009 .

[202]  Marius Adrian Marin,et al.  An Integrated System to Manage Crosscutting Concerns in Source Code , 2008 .

[203]  Kab Kevin Verbeek.  Algorithms for cartographic visualization , 2012 .

[204]  A Adam Koprowski,et al.  Termination of rewriting and its certification , 2004 .

[205]  Christian Krause,et al.  Reconfigurable Component Connectors , 2011 .