Handling combinatorial explosion in software testing

In this thesis, the overall conclusion is that combination strategies, (i.e., test case selection methods that manage the combinatorial explosion of possible things to test), can improve the softwa ...

[1]  Henryk Jan Komorowski,et al.  A specification of an abstract Prolog machine and its application to partial evaluation , 1981 .

[2]  Christina Ölvingson,et al.  On development of information systems with GIS functionality in public health informatics : a requirements engineering approach , 2003 .

[3]  Eva L. Ragnemalm,et al.  Student modelling based on collaborative dialogue with a learning companion , 1999 .

[4]  C. L. Mallows,et al.  Applying Design of Experiments to Software Testing , 1997, Proceedings of the (19th) International Conference on Software Engineering.

[5]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[6]  Ola Angelsmark.  Constructing Algorithms for Constraint Satisfaction and Related Problems : Methods and Applications , 2005 .

[7]  Tim Heyer,et al.  Semantic Inspection of Software Artifacts From Theory to Practice , 2001 .

[8]  Anders Avdic,et al.  Användare och utvecklare : om anveckling med kalkylprogram , 2001 .

[9]  Fredrik Karlsson,et al.  Method configuration: method and computerized tool support , 2005 .

[10]  Jörgen Lindström,et al.  Does distance matter? On geographical dispersion in organisations , 1999 .

[11]  Fredrik Nilsson.  Strategi och ekonomisk styrning : en studie av hur ekonomiska styrsystem utformas och används efter företagsförvärv , 1997 .

[12]  Yashwant K. Malaiya,et al.  Automatic test generation using checkpoint encoding and antirandom testing , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[13]  Mikael Lind,et al.  Från system till process kriterier för processbestämning vid verksamhetsanalys , 2001 .

[14]  Paul Scerri,et al.  Designing agents for systems with adjustable autonomy , 2001 .

[15]  Stefan Holmlid,et al.  Adapting users : towards a theory of use quality , 2002 .

[16]  Lars Hult,et al.  Publika informationstjänster : en studie av den elektroniska encyklopedins bruksegenskaper , 2003 .

[17]  P. Doherty.  NML3 : a non-monotonic formalism with explicit defaults , 1991 .

[18]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[19]  Paul Ammann,et al.  Using formal methods to derive test frames in category-partition testing , 1994, Proceedings of COMPASS'94 - 1994 IEEE 9th Annual Conference on Computer Assurance.

[20]  Lars Degerstedt,et al.  Tabulation-based Logic Programming : A Multi-level View of Query Answering , 1996 .

[21]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[22]  Alexander Pretschner,et al.  Model-Based Testing in Practice , 2005, FM.

[23]  Malin Nordström,et al.  Styrbar systemförvaltning : att organisera systemförvaltningsverksamhet med hjälp av effektiva förvaltningsobjekt , 2005 .

[24]  Sture Hägglund,et al.  Contributions to the development of methods and tools for interactive design of applications software , 1980 .

[25]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[26]  Linda Askenäs,et al.  The roles of IT : studies of organising when implementing and using enterprise systems , 2004 .

[27]  Edward Yourdon,et al.  Techniques of Program Structure and Design , 1976 .

[28]  Aseel Berglund,et al.  Augmenting the Remote Control: Studies in Complex Information Navigation for Digital TV , 2004 .

[29]  Robert L. Probert,et al.  A practical strategy for testing pair-wise coverage of network interfaces , 1996, Proceedings of ISSRE '96: 7th International Symposium on Software Reliability Engineering.

[30]  Stuart Reid,et al.  An empirical analysis of equivalence partitioning, boundary value analysis and random testing , 1997, Proceedings Fourth International Software Metrics Symposium.

[31]  Vadim Engelson,et al.  Tools for design, interactive simulation, and visualization of object-oriented models in scientific computing , 2000 .

[32]  Vilhelm Dahllöf,et al.  Exact Algorithms for Exact Satisfiability Problems , 2006 .

[33]  Jonas Hallberg,et al.  Timing issues in high-level synthesis , 1998 .

[34]  Annika Flycht-Eriksson,et al.  Design and use of ontologies in information-providing dialogue systems , 2004 .

[35]  Mariam Kamkar,et al.  Interprocedural dynamic slicing with applications to debugging and testing , 1993, Linköping studies in science and technology dissertations.

[36]  Per-Arne Persson,et al.  Bringing power and knowledge together: information systems design for autonomy and control in command work , 2000 .

[37]  Yuxiao Zhao,et al.  Standards-based application integration for business-to-business communications , 2005 .

[38]  Robert Nilsson,et al.  A Mutation-based Framework for Automated Testing of Timeliness , 2006 .

[39]  Johan Åberg,et al.  Live help systems : an approach to intelligent help for Web information systems , 2002 .

[40]  J. Skåmedal.  Telecommuting's implications on travel and travel patterns , 2004 .

[41]  Åsa Hedenskog,et al.  Perceive those things which cannot be seen : A cognitive systems engineering perspective on requirements management , 2006 .

[42]  Asmus Pandikow,et al.  A Generic Principle for Enabling Interoperability of Structured and Object-Oriented Analysis and Design Tools , 2002 .

[43]  Jimmy Tjäder,et al.  Systemimplementering i praktiken : en studie av logiker i fyra projekt , 1999 .

[44]  H. Kopetz,et al.  Dependability: Basic Concepts and Terminology , 1992, Dependable Computing and Fault-Tolerant Systems.

[45]  Simin Nadjm-Tehrani,et al.  Algorithms and Complexity for Temporal and Spatial Formalisms , 2007 .

[46]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[47]  Niklas Hallberg,et al.  Incorporating user values in the design of information systems and services in the public sector : a methods approach , 1999 .

[48]  Andrzej Bednarski,et al.  Integrated Optimal Code Generation for Digital Signal Processors , 2006 .

[49]  Anders Arpteg,et al.  Intelligent Semi-Structured Information Extraction , 2005 .

[50]  Rego Granlund,et al.  Monitoring distributed teamwork training , 2002 .

[51]  Zhiping Wang.  Capacity-constrained production-inventory systems : modelling and analysis in both a traditional and an e-business context , 2004 .

[52]  Patrik Haslum,et al.  Admissible Heuristics for Automated Planning , 2006 .

[53]  Tarja Susi.  The puzzle of social activity: the significance of tools in cognition and cooperation , 2006 .

[54]  Magnus Merkel,et al.  Understanding and enhancing translation by parallel text processing , 1999 .

[55]  Anette Moberg.  Närhet och distans : studier av kommunikationsmönster i satellitkontor och flexibla kontor , 1997 .

[56]  Yu Lei,et al.  In-parameter-order: a test generation strategy for pairwise testing , 1998, Proceedings Third IEEE International High-Assurance Systems Engineering Symposium (Cat. No.98EX231).

[57]  Jonas Mellin,et al.  Managing Conflicts When Using Combination Strategies to Test Software , 2007, 2007 Australian Software Engineering Conference (ASWEC'07).

[58]  Ulf Seigerroth,et al.  Att förstå och förändra systemutvecklingsverksamheter en taxonomi för metautveckling , 2003 .

[59]  Jonas Kvarnström,et al.  TALplanner and Other Extensions to Temporal Action Logic , 2005 .

[60]  David Dinka,et al.  Role, Identity and Work : Extending the design and development agenda , 2010 .

[61]  Erik Herzog,et al.  An approach to systems engineering tool data representation and exchange , 2004 .

[62]  Siddhartha R. Dalal,et al.  Model-based testing in practice , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[63]  Åsa G. Dahlstedt.  Guidelines Regarding Requirements Engineering Practices in order to Facilitate System Testing , 2005 .

[64]  Jon Edvardsson,et al.  Techniques for Automatic Generation of Tests from Programs and Specifications , 2006 .

[65]  Tatsuhiro Tsuchiya,et al.  Using artificial life techniques to generate test cases for combinatorial testing , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[66]  Ewa Braf,et al.  Knowledge demanded for action : studies of knowledge mediation in organisations , 2004 .

[67]  Pernilla Qvarfordt,et al.  Eyes on multimodal interaction , 2004 .

[68]  Tobias Ritzau,et al.  Memory Efficient Hard Real-Time Garbage Collection , 2003 .

[69]  Silvia Coradeschi,et al.  Anchoring symbols to sensory data , 1999 .

[70]  Genevieve Gorrell,et al.  Generalized Hebbian Algorithm for Dimensionality Reduction in Natural Language Processing , 2006 .

[71]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[72]  Sigrid Eldh.  Software Testing Techniques , 2007 .

[73]  Joachim Karlsson,et al.  A systematic approach for prioritizing software requirements , 1998 .

[74]  Ioan Chisalita,et al.  Communication and Networking Techniques for Traffic Safety Systems , 2006 .

[75]  Mikael Ericsson,et al.  Supporting the use of design knowledge : an assessment of commenting agents , 1999 .

[76]  Glenford J. Myers,et al.  A controlled experiment in program testing and code walkthroughs/inspections , 1978, CACM.

[77]  Pär Carlshamre,et al.  A usability perspective on requirements engineering : from methodology to product development , 2001 .

[78]  Luis Alejandro Cortés,et al.  Verification and Scheduling Techniques for Real-Time Embedded Systems , 2005 .

[79]  Kjell Orsborn,et al.  On Extensible and Object-Relational Database Technology for Finite Element Analysis Applications , 1996 .

[80]  Esa Falkenroth.  Database technology for control and simulation , 2000 .

[81]  William C. Hetzel,et al.  An experimental analysis of program verification methods. , 1976 .

[82]  Steven P. Miller,et al.  Applicability of modified condition/decision coverage to software testing , 1994, Softw. Eng. J..

[83]  John D. Gannon,et al.  Verification and Validation , 1997, The Computer Science and Engineering Handbook.

[84]  Pär J. Ågerfalk.  Information Systems Actability: Understanding Information Technology as a Tool for Business Action and Communication , 2003 .

[85]  Olof Johansson.  Development environments for complex product models , 1996 .

[86]  Peter Aronsson,et al.  Automatic Parallelization of Equation-Based Simulation Programs , 2006 .

[87]  N. Dahlbäck,et al.  Representations of discourse : cognitive and computational aspects , 1991 .

[88]  Arne Jönsson,et al.  Dialogue management for natural language interfaces - an empirical approach , 1993, Linköping studies in science and technology dissertations.

[89]  Bourhane Kadmiry,et al.  Fuzzy gain scheduled visual servoing for an unmanned helicopter , 2005 .

[90]  Johan Fagerström,et al.  A paradigm and system for design of distributed systems , 1988 .

[91]  Mathias Broxvall,et al.  A Study in the Computational Complexity of Temporal Reasoning , 2002 .

[92]  Man Lin.  Analysis and synthesis of reactive systems : a generic layered architecture perspective , 1999 .

[93]  Iakov Nakhimovski,et al.  Contributions to the Modeling and Simulation of Mechanical Systems with Detailed Contact Analyses , 2006 .

[94]  Staffan Bonnier,et al.  A formal basis for horn clause logic with external polymorphic functions , 1992 .

[95]  Vaida Jakoniene,et al.  Integration of Biological Data , 2006 .

[96]  Jörgen Hansson,et al.  Value-driven multi-class overload management in real-time database systems , 1999 .

[97]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[98]  Hans Olsen,et al.  Automatic Verification of Petri Nets in a CLP Framework , 1997 .

[99]  Jeff Offutt,et al.  Input parameter modeling for combination strategies , 2007, ICSE 2007.

[100]  Vivian Vimarlund,et al.  An economic perspective on the analysis of impacts of information technology : from case studies in health-care towards general models and theories , 1999 .

[101]  R. L. Erickson,et al.  Improved quality of protocol testing through techniques of experimental design , 1994, Proceedings of ICC/SUPERCOMM'94 - 1994 International Conference on Communications.

[102]  Aleksandra Tesanovic,et al.  Developing Reusable and Reconfigurable Real-Time Software using Aspects and Components , 2006 .

[103]  Henrik Nilsson,et al.  Declarative debugging for lazy functional languages , 1998 .

[104]  Anneliese Amschler Andrews,et al.  On domain models for system testing , 1996, Proceedings of Fourth IEEE International Conference on Software Reuse.

[105]  Magnus Morin.  Multimedia representations of distributed tactical operations , 2002 .

[106]  Magnus Bång.  Computing at the speed of paper : ubiquitous computing environments for healthcare professionals , 2004 .

[107]  Jonas Mellin,et al.  On the Testing Maturity of Software Producing Organizations , 2006, Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06).

[108]  Daniel P. Siewiorek,et al.  Automated robustness testing of off-the-shelf software components , 1998, Digest of Papers. Twenty-Eighth Annual International Symposium on Fault-Tolerant Computing (Cat. No.98CB36224).

[109]  Erik Anders Tengvald,et al.  The design of expert planning systems: an experimental operations planning system for turning , 1984 .

[110]  Daniel Karlsson,et al.  Verification of Component-based Embedded System Designs , 2006 .

[111]  Erik Berglund,et al.  Library Communication Among Programmers Worldwide , 2002 .

[112]  Ching-Lai Hwang,et al.  Basic Concepts and Terminology , 1979 .

[113]  Björn Johansson.  Joint control in dynamic situations , 2005 .

[114]  Carl-Johan Petri,et al.  Organizational information provision : managing mandatory and discretionary utilization of information technology , 2001 .

[115]  Daniel Hoffman,et al.  A framework for table driven testing of Java classes , 2002, Softw. Pract. Exp..

[116]  Joakim Gustafsson,et al.  Extending temporal action logic , 2001 .

[117]  Dimiter Driankov,et al.  Towards a many‐valued logic of quantified belief: The information lattice , 1991 .

[118]  Erland Jungert,et al.  Synthesizing database structures from a user oriented data model , 1980 .

[119]  Zebo Peng.  A formal methodology for automated synthesis of VLSI systems , 1987 .

[120]  Alan W. Williams,et al.  Determination of Test Configurations for Pair-Wise Interaction Coverage , 2000, TestCom.

[121]  K. Burr,et al.  Combinatorial Test Techniques : Table-based Automation , Test Generation and Code Coverage , 1998 .

[122]  Mikael Kindborg,et al.  Concurrent comics : programming of social agents by children , 2003 .

[123]  Jonas Mellin,et al.  Resource-Predictable and Efficient Monitoring of Events , 2004 .

[124]  Ulf Nilsson,et al.  Abstract Interpretation & Abstract Machines: Contribution to a Methodology for the Implementation of Logic Programs , 1992 .

[125]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[126]  Mikael Ronström,et al.  Design and Modelling of a Parallel Data Server for Telecom Applications , 2004 .

[127]  Mattias Arvola,et al.  Shades of Use: The Dynamics of Interaction Design for Sociable Use , 2005 .

[128]  Johan Jenvald.  Methods and tools in computer-supported taskforce training , 1999 .

[129]  Myra B. Cohen,et al.  Covering arrays for efficient fault characterization in complex configuration spaces , 2004, IEEE Transactions on Software Engineering.

[130]  Pär Emanuelson,et al.  Performance enhancement in a well-structured pattern matcher through partial evaluation , 1980 .

[131]  Lin Padgham,et al.  Non-monotonic inheritance for an object-oriented knowledge-base , 1989 .

[132]  Sorin Manolache,et al.  Analysis and Optimisation of Real-Time Systems with Stochastic Behaviour , 2005 .

[133]  Sofie Pilemalm,et al.  Information Technology for Non-Profit Organisations: Extended Participatory Design of an Information System for Trade Union Shop Stewards , 2002 .

[134]  Barry W. Boehm.  SOME INFORMATION PROCESSING IMPLICATIONS OF AIR FORCE SPACE MISSIONS: 1970-1980 , 1970 .

[135]  Matthias Grochtmann,et al.  Classification trees for partition testing , 1993, Softw. Test. Verification Reliab..

[136]  Michael L. Fredman,et al.  The AETG System: An Approach to Testing Based on Combinatiorial Design , 1997, IEEE Trans. Software Eng..

[137]  D.M. Cohen,et al.  The Combinatorial Design Approach to Automatic Test Generation , 1996, IEEE Softw..

[138]  M.R. Smith,et al.  A survey of software testing practices in alberta , 2004, Canadian Journal of Electrical and Computer Engineering.

[139]  A. Jefferson Offutt,et al.  An evaluation of combination strategies for test case selection , 2006, Empirical Software Engineering.

[140]  Peter Ambjorn Fritzson,et al.  Towards a distributed programming environment based on incremental compilation (debugging, prettyprinting, interactive) , 1984 .

[141]  Rita Kovordanyi,et al.  Modeling and simulating inhibitory mechanisms in mental image reinterpretation : towards cooperative human-computer creativity , 1999 .

[142]  Choong-ho Yi,et al.  Modelling object-oriented dynamic systems using a logic-based framework , 2002 .

[143]  Anneli Hagdahl,et al.  Development of IT-supported Inter-organisational Collaboration: A Case Study in the Swedish Public Sector , 2002 .

[144]  Juha Takkinen,et al.  From information management to task management in electronic mail , 2002 .

[145]  Pawel Pietrzak,et al.  A type-based framework for locating errors in constraint logic programs , 2002 .

[146]  C. Curescu,et al.  Utility-based Optimisation of Resource Allocation for Wireless Networks , 2005 .

[147]  Stefan Cronholm,et al.  Metodverktyg och användbarhet : en studie av datorstödd metodbaserad systemutveckling , 1998 .

[148]  Fred P. Brooks,et al.  The Mythical Man-Month , 1975, Reliable Software.

[149]  Anders Lindström,et al.  English and other foreign linguistic elements in spoken Swedish : studies of productive processes and their modelling using finite-state tools , 2004 .

[150]  Colin L. Mallows,et al.  Factor-covering designs for testing software , 1998 .

[151]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[152]  Jaime Villegas,et al.  Simulation supported industrial training from an organisational learning perspective : development and evaluation of the SSIT method , 1996 .

[153]  C. Levcopoulos.  Heuristics for minimum decompositions of polygons , 1987 .

[154]  Mats Grindal,et al.  Thesis Proposal : Evaluation of Combination Strategies for Practical Testing , 2004 .

[155]  Nahid Shahmehri,et al.  Generalized algorithmic debugging , 1991 .

[156]  Magnus Kald.  In the borderland between strategy and management control : theoretical framework and empirical evidence , 2004 .

[157]  Yu Lei,et al.  A Test Generation Strategy for Pairwise Testing , 2002, IEEE Trans. Software Eng..

[158]  Diana Szentiványi.  Performance Studies of Fault-Tolerant Middleware , 2005 .

[159]  Hermann Kopetz,et al.  Dependability: Basic Concepts and Terminology , 1992 .

[160]  Per Runeson,et al.  Journal of Software Maintenance and Evolution: Research and Practice Test Processes in Software Product Evolution—a Qualitative Survey on the State of Practice , 2022 .

[161]  Jerry Huller.  Reducing Time to Market with Combinatorial Design Method Testing , 2002 .

[162]  Siddhartha R. Dalal,et al.  The Automatic Efficient Test Generator (AETG) system , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[163]  Tore Risch,et al.  Compilation of multiple file queries in a meta-database system , 1978 .

[164]  Mikael Cäker,et al.  Management accounting as constructing and opposing customer focus : three case studies on management accounting and customer relations , 2005 .

[165]  Robert Mandl,et al.  Orthogonal Latin squares: an application of experiment design to compiler testing , 1985, CACM.

[166]  Yong Rae Kwon,et al.  An empirical evaluation of six methods to detect faults in software , 2002, Softw. Test. Verification Reliab..

[167]  Erik G. Larsson,et al.  An Integrated System-Level Design for Testability Methodology , 2000 .

[168]  Martin Skold.  Active Database Management Systems for Monitoring and Control , 1997 .

[169]  Osten Oskarsson,et al.  Mechanisms of modifiability in large software systems , 1982 .

[170]  Christer Backstrom,et al.  Computational Complexity of Reasoning about Plans , 1992 .

[171]  Victor R. Basili,et al.  Comparing the Effectiveness of Software Testing Strategies , 1987, IEEE Transactions on Software Engineering.

[172]  Tsong Yueh Chen,et al.  Identification of categories and choices in activity diagrams , 2005, Fifth International Conference on Quality Software (QSIC'05).

[173]  Marcus Bjäreland.  Model-based execution monitoring , 2001 .

[174]  Dan Lawesson.  An Approach to Diagnosability Analysis for Interacting Finite State Systems , 2005 .

[175]  Vanja Josifovski,et al.  Design, implementation and evaluation of a distributed mediator system for data integration , 1999 .

[176]  Peter Bunus,et al.  Debugging techniques for equation-based languages , 2004 .

[177]  Claudiu Duma,et al.  Security and trust mechanisms for groups in distributed services , 2005 .

[178]  Ling Lin,et al.  Management of 1-D Sequence Data- From Discrete to Continuous , 1999 .

[179]  Gert Jervan,et al.  Hybrid Built-In Self-Test and Test Generation Techniques for Digital Systems , 2005 .

[180]  Mikael Lindvall,et al.  An Empirical Study of Requirements-Driven Impact Analysis in Object-Oriented Software Evolution , 1997 .

[181]  ComplexityPeter Jonsson,et al.  Studies in Action Planning Algorithms and Complexity , 2007 .

[182]  Yu-Hsing Huang,et al.  Having a New Pair of Glasses: Applying Systemic Accident Models on Road Safety , 2007 .

[183]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.