Testability of Dynamic Real-Time Systems

This dissertation concerns testability of event-triggered real-time systems. Real-time systems are known to be hard to test because they are required to function correct both with respect to what the system does and when it does it. An event-triggered real-time system is directly controlled by the events that occur in the environment, as opposed to a time-triggered system, which behavior with respect to when the system does something is constrained, and therefore more predictable. The focus in this dissertation is the behavior in the time domain and it is shown how testability is affected by some factors when the system is tested for timeliness. This dissertation presents a survey of research that focuses on software testability and testability of real-time systems. The survey motivates both the view of testability taken in this dissertation and the metric that is chosen to measure testability in an experiment. We define a method to generate sets of traces from a model by using a meta algorithm on top of a model checker. Defining such a method is a necessary step to perform the experiment. However, the trace sets generated by this method can also be used by test strategies that are based on orderings, for example execution orders. An experimental study is presented in detail. The experiment investigates how testability of an event-triggered real-time system is affected by some constraining properties of the execution environment. The experiment investigates the effect on testability from three different constraints regarding preemptions, observations and process instances. All of these constraints were claimed in previous work to be significant factors for the level of testability. Our results support the claim for the first two of the constraints while the third constraint shows no impact on the level of testability. Finally, this dissertation discusses the effect on the event-triggered semantics when the constraints are applied on the execution environment. The result from this discussion is that the first two constraints do not change the semantics while the third one does. This result indicates that a constraint on the number of process instances might be less useful for some event-triggered real-time systems.

[1]  Magnus Kald.  In the borderland between strategy and management control : theoretical framework and empirical evidence , 2004 .

[2]  J. Voas,et al.  Software Testability: The New Verification , 1995, IEEE Softw..

[3]  Sanny Syberfeldt,et al.  Optimistic Replication with Forward Conflict Resolution in Distributed Real-Time Databases , 2007 .

[4]  Vahid Garousi,et al.  Traffic-aware Stress Testing of Distributed Real-Time Systems Based on UML Models in the Presence of Time Uncertainty , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[5]  Ye Wu,et al.  Testing and Quality Assurance for Component-Based Software , 2003 .

[6]  Arne Jönsson,et al.  Dialogue management for natural language interfaces - an empirical approach , 1993, Linköping studies in science and technology dissertations.

[7]  Bourhane Kadmiry,et al.  Fuzzy gain scheduled visual servoing for an unmanned helicopter , 2005 .

[8]  Anders Larsson,et al.  Test Optimization for Core-based System-on-Chip , 2008 .

[9]  Diana Szentiványi.  Performance Studies of Fault-Tolerant Middleware , 2005 .

[10]  John P. Lehoczky,et al.  An optimal algorithm for scheduling soft-aperiodic tasks in fixed-priority preemptive systems , 1992, [1992] Proceedings Real-Time Systems Symposium.

[11]  Magnus Bång.  Computing at the speed of paper : ubiquitous computing environments for healthcare professionals , 2004 .

[12]  Pontus Wärnestål,et al.  Dialogue Behavior Management in Conversational Recommender Systems , 2007 .

[13]  Wang Yi,et al.  Efficient Timed Reachability Analysis Using Clock Difference Diagrams , 1998, CAV.

[14]  Daniel Karlsson,et al.  Verification of Component-based Embedded System Designs , 2006 .

[15]  Paul Scerri,et al.  Designing agents for systems with adjustable autonomy , 2001 .

[16]  Gerard J. Holzmann,et al.  The SPIN Model Checker - primer and reference manual , 2003 .

[17]  Vadim Engelson,et al.  Tools for design, interactive simulation, and visualization of object-oriented models in scientific computing , 2000 .

[18]  Vilhelm Dahllöf,et al.  Exact Algorithms for Exact Satisfiability Problems , 2006 .

[19]  Jonas Hallberg,et al.  Timing issues in high-level synthesis , 1998 .

[20]  Janusz W. Laski,et al.  A Data Flow Oriented Program Testing Strategy , 1983, IEEE Transactions on Software Engineering.

[21]  浅井 徹.  39th IEEE Conference on Decision and Control , 2001 .

[22]  Henrik Thane,et al.  Monitoring, Testing and Debugging of Distributed Real-Time Systems , 2000 .

[23]  Adrian Pop,et al.  Integrated Model-Driven Development Environments for Equation-Based Object-Oriented Languages , 2008 .

[24]  Gert Jervan,et al.  Hybrid Built-In Self-Test and Test Generation Techniques for Digital Systems , 2005 .

[25]  Gerard J. Holzmann,et al.  The Model Checker SPIN , 1997, IEEE Trans. Software Eng..

[26]  Mikael Lindvall,et al.  An Empirical Study of Requirements-Driven Impact Analysis in Object-Oriented Software Evolution , 1997 .

[27]  Anette Moberg.  Närhet och distans : studier av kommunikationsmönster i satellitkontor och flexibla kontor , 1997 .

[28]  Ulf Seigerroth,et al.  Att förstå och förändra systemutvecklingsverksamheter en taxonomi för metautveckling , 2003 .

[29]  Henryk Jan Komorowski,et al.  A specification of an abstract Prolog machine and its application to partial evaluation , 1981 .

[30]  Eva L. Ragnemalm,et al.  Student modelling based on collaborative dialogue with a learning companion , 1999 .

[31]  Christina Ölvingson,et al.  On development of information systems with GIS functionality in public health informatics : a requirements engineering approach , 2003 .

[32]  Robert V. Binder,et al.  Design for testability in object-oriented systems , 1994, CACM.

[33]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[34]  Pär J. Ågerfalk.  Information Systems Actability: Understanding Information Technology as a Tool for Business Action and Communication , 2003 .

[35]  Tobias Ritzau,et al.  Memory Efficient Hard Real-Time Garbage Collection , 2003 .

[36]  Beatrice Alenljung,et al.  Envisioning a Future Decision Support System for Requirements Engineering : A Holistic and Human-centred Perspective , 2008 .

[37]  Pär Emanuelson,et al.  Performance enhancement in a well-structured pattern matcher through partial evaluation , 1980 .

[38]  Lin Padgham,et al.  Non-monotonic inheritance for an object-oriented knowledge-base , 1989 .

[39]  Jaime Villegas,et al.  Simulation supported industrial training from an organisational learning perspective : development and evaluation of the SSIT method , 1996 .

[40]  J. Knottnerus,et al.  Real world research. , 2010, Journal of clinical epidemiology.

[41]  C. Levcopoulos.  Heuristics for minimum decompositions of polygons , 1987 .

[42]  Nahid Shahmehri,et al.  Generalized algorithmic debugging , 1991 .

[43]  Mehdi Amirijoo,et al.  QoS Control of Real-Time Data Services under Uncertain Workload , 2007 .

[44]  Sorin Manolache,et al.  Analysis and Optimisation of Real-Time Systems with Stochastic Behaviour , 2005 .

[45]  Sofie Pilemalm,et al.  Information Technology for Non-Profit Organisations: Extended Participatory Design of an Information System for Trade Union Shop Stewards , 2002 .

[46]  Lui Sha,et al.  Aperiodic task scheduling for Hard-Real-Time systems , 2006, Real-Time Systems.

[47]  Joe Heike Steinhauer.  A Representation Scheme for Description and Reconstruction of Object Configurations Based on Qualitative Relations , 2008 .

[48]  Wanchai Rivepiboon,et al.  An analysis technique to increase testability of object‐oriented components , 2008, Softw. Test. Verification Reliab..

[49]  Marc F. Witteman,et al.  Design for Testability in Hardware-Software Systems , 1996, IEEE Des. Test Comput..

[50]  Vivian Vimarlund,et al.  An economic perspective on the analysis of impacts of information technology : from case studies in health-care towards general models and theories , 1999 .

[51]  Andrzej Bednarski,et al.  Integrated Optimal Code Generation for Digital Signal Processors , 2006 .

[52]  Mariam Kamkar,et al.  Interprocedural dynamic slicing with applications to debugging and testing , 1993, Linköping studies in science and technology dissertations.

[53]  Yingxu Wang,et al.  A method for built-in tests in component-based software maintenance , 1999, Proceedings of the Third European Conference on Software Maintenance and Reengineering (Cat. No. PR00090).

[54]  Staffan Bonnier,et al.  A formal basis for horn clause logic with external polymorphic functions , 1992 .

[55]  ComplexityPeter Jonsson,et al.  Studies in Action Planning Algorithms and Complexity , 2007 .

[56]  Angelo Gargantini,et al.  Using model checking to generate tests from requirements specifications , 1999, ESEC/FSE-7.

[57]  Per-Arne Persson,et al.  Bringing power and knowledge together: information systems design for autonomy and control in command work , 2000 .

[58]  Yu-Hsing Huang,et al.  Having a New Pair of Glasses: Applying Systemic Accident Models on Road Safety , 2007 .

[59]  Erik G. Larsson,et al.  An Integrated System-Level Design for Testability Methodology , 2000 .

[60]  Genevieve Gorrell,et al.  Generalized Hebbian Algorithm for Dimensionality Reduction in Natural Language Processing , 2006 .

[61]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[62]  Magnus Wahlström,et al.  Algorithms, measures and upper bounds for satisfiability and related problems , 2007 .

[63]  Annika Flycht-Eriksson,et al.  Design and use of ontologies in information-providing dialogue systems , 2004 .

[64]  Mats Grindal,et al.  Handling combinatorial explosion in software testing , 2007 .

[65]  Vaida Jakoniene,et al.  Integration of Biological Data , 2006 .

[66]  Theodore P. Baker,et al.  Stack-based scheduling of realtime processes , 1991, Real-Time Systems.

[67]  Martin Skold.  Active Database Management Systems for Monitoring and Control , 1997 .

[68]  A. Fleischmann.  Distributed Systems , 1994, Springer Berlin Heidelberg.

[69]  Hans A. Hansson,et al.  Towards systematic testing of distributed real-time systems , 1999, Proceedings 20th IEEE Real-Time Systems Symposium (Cat. No.99CB37054).

[70]  Åsa Hedenskog,et al.  Perceive those things which cannot be seen : A cognitive systems engineering perspective on requirements management , 2006 .

[71]  Ulf Johansson,et al.  Obtaining Accurate and Comprehensible Data Mining Models: An Evolutionary Approach , 2007 .

[72]  Jimmy Tjäder,et al.  Systemimplementering i praktiken : en studie av logiker i fyra projekt , 1999 .

[73]  Simin Nadjm-Tehrani,et al.  Algorithms and Complexity for Temporal and Spatial Formalisms , 2007 .

[74]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[75]  Mikael Ronström,et al.  Design and Modelling of a Parallel Data Server for Telecom Applications , 2004 .

[76]  Jörgen Hansson,et al.  Active and Real-Time Database Systems (ARTDB-95) , 1995, Workshops in Computing.

[77]  Osten Oskarsson,et al.  Mechanisms of modifiability in large software systems , 1982 .

[78]  Christer Backstrom,et al.  Computational Complexity of Reasoning about Plans , 1992 .

[79]  Magnus Morin.  Multimedia representations of distributed tactical operations , 2002 .

[80]  HeitmeyerConstance,et al.  Using model checking to generate tests from requirements specifications , 1999 .

[81]  Wei Ding,et al.  Model Checkers in Software Testing , 2002 .

[82]  Marcus Bjäreland.  Model-based execution monitoring , 2001 .

[83]  Luciano Baresi,et al.  An Introduction to Software Testing , 2006, FoVMT.

[84]  Dan Lawesson.  An Approach to Diagnosability Analysis for Interacting Finite State Systems , 2005 .

[85]  Per Ola Kristensson,et al.  Discrete and Continuous Shape Writing for Text Entry and Control , 2007 .

[86]  Anders Avdic,et al.  Användare och utvecklare : om anveckling med kalkylprogram , 2001 .

[87]  Stefan Holmlid,et al.  Adapting users : towards a theory of use quality , 2002 .

[88]  Werner Schütz,et al.  Fundamental issues in testing distributed real-time systems , 1994, Real-Time Systems.

[89]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[90]  Malin Nordström,et al.  Styrbar systemförvaltning : att organisera systemförvaltningsverksamhet med hjälp av effektiva förvaltningsobjekt , 2005 .

[91]  Sture Hägglund,et al.  Contributions to the development of methods and tools for interactive design of applications software , 1980 .

[92]  John A. Stankovic,et al.  Misconceptions About Real-Time Computing , 1988, Computer.

[93]  Jeffrey M. Voas,et al.  Semantic metrics for software testability , 1993, J. Syst. Softw..

[94]  Lionel C. Briand,et al.  A measurement framework for object-oriented software testability , 2005, Inf. Softw. Technol..

[95]  Linda Askenäs,et al.  The roles of IT : studies of organising when implementing and using enterprise systems , 2004 .

[96]  Bogdan Korel,et al.  Automated Software Test Data Generation , 1990, IEEE Trans. Software Eng..

[97]  Aseel Berglund,et al.  Augmenting the Remote Control: Studies in Complex Information Navigation for Digital TV , 2004 .

[98]  Jonas Kvarnström,et al.  TALplanner and Other Extensions to Temporal Action Logic , 2005 .

[99]  David Dinka,et al.  Role, Identity and Work : Extending the design and development agenda , 2010 .

[100]  Steven P. Miller,et al.  Applicability of modified condition/decision coverage to software testing , 1994, Softw. Eng. J..

[101]  Erik Herzog,et al.  An approach to systems engineering tool data representation and exchange , 2004 .

[102]  David Byers.  Towards estimating software testability using static analysis , 1997 .

[103]  Jon Edvardsson,et al.  Techniques for Automatic Generation of Tests from Programs and Specifications , 2006 .

[104]  Krithi Ramamritham,et al.  The Origin of TCs , 1995, ARTDB.

[105]  Arnaud Gotlieb,et al.  Automatic test data generation using constraint solving techniques , 1998, ISSTA '98.

[106]  Imad Abugessaisa,et al.  Analytical tools and information-sharing methods supporting road safety organizations , 2008 .

[107]  Silvia Coradeschi,et al.  Anchoring symbols to sensory data , 1999 .

[108]  Ewa Braf,et al.  Knowledge demanded for action : studies of knowledge mediation in organisations , 2004 .

[109]  René Boel.  Automatic Synthesis of Schedules in a Timed Discrete Event Plant , 2000 .

[110]  James M. Bieman,et al.  Generating input data structures for automated program testing , 2009, Softw. Test. Verification Reliab..

[111]  Ola Angelsmark.  Constructing Algorithms for Constraint Satisfaction and Related Problems : Methods and Applications , 2005 .

[112]  Joakim Gustafsson,et al.  Extending temporal action logic , 2001 .

[113]  Jürgen Nehmer,et al.  Operating Systems of the 90s and Beyond , 1991, Lecture Notes in Computer Science.

[114]  Mattias Arvola,et al.  Shades of Use: The Dynamics of Interaction Design for Sociable Use , 2005 .

[115]  Peter Aronsson,et al.  Automatic Parallelization of Equation-Based Simulation Programs , 2006 .

[116]  N. Dahlbäck,et al.  Representations of discourse : cognitive and computational aspects , 1991 .

[117]  A. Jefferson Offutt,et al.  An evaluation of combination strategies for test case selection , 2006, Empirical Software Engineering.

[118]  James M. Bieman,et al.  Generating input data structures for automated program testing , 2009 .

[119]  Thomas Gustafsson,et al.  Management of Real-Time Data Consistency and Transient Overloads in Embedded Systems , 2007 .

[120]  A. Jefferson Offutt,et al.  The Dynamic Domain Reduction Procedure for Test Data Generation: Design and Algorithms , 1994 .

[121]  Tim Heyer,et al.  Semantic Inspection of Software Artifacts From Theory to Practice , 2001 .

[122]  Fredrik Karlsson,et al.  Method configuration: method and computerized tool support , 2005 .

[123]  Vi Andrew Jefferson Offutt,et al.  Automatic test data generation , 1988 .

[124]  Dimiter Driankov,et al.  Towards a many‐valued logic of quantified belief: The information lattice , 1991 .

[125]  Erland Jungert,et al.  Synthesizing database structures from a user oriented data model , 1980 .

[126]  Peter Ambjorn Fritzson,et al.  Towards a distributed programming environment based on incremental compilation (debugging, prettyprinting, interactive) , 1984 .

[127]  Sarfraz Khurshid,et al.  Test input generation with java PathFinder , 2004, ISSTA '04.

[128]  Rego Granlund,et al.  Monitoring distributed teamwork training , 2002 .

[129]  Zhiping Wang.  Capacity-constrained production-inventory systems : modelling and analysis in both a traditional and an e-business context , 2004 .

[130]  Almut Herzog,et al.  Linköping Studies in Science and Technology Usable Security Policies for Runtime Environments , 2022 .

[131]  Jonathan P. Bowen,et al.  Reinforced Condition/Decision Coverage (RC/DC): A New Criterion for Software Testing , 2002, ZB.

[132]  Patrik Haslum,et al.  Admissible Heuristics for Automated Planning , 2006 .

[133]  P. Doherty.  NML3 : a non-monotonic formalism with explicit defaults , 1991 .

[134]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[135]  Jörgen Lindström,et al.  Does distance matter? On geographical dispersion in organisations , 1999 .

[136]  Fredrik Nilsson.  Strategi och ekonomisk styrning : en studie av hur ekonomiska styrsystem utformas och används efter företagsförvärv , 1997 .

[137]  Alexandru Andrei,et al.  Energy Efficient and Predictable Design of Real-Time Embedded Systems , 2007 .

[138]  Boris Beizer,et al.  Software testing techniques (2. ed.) , 1990 .

[139]  Niklas Hallberg,et al.  Incorporating user values in the design of information systems and services in the public sector : a methods approach , 1999 .

[140]  Alan Burns,et al.  Scheduling slack time in fixed priority pre-emptive systems , 1993, 1993 Proceedings Real-Time Systems Symposium.

[141]  Zebo Peng.  A formal methodology for automated synthesis of VLSI systems , 1987 .

[142]  J. Lindblom.  Minding the Body: Interacting socially through embodied action , 2007 .

[143]  Rita Kovordanyi,et al.  Modeling and simulating inhibitory mechanisms in mental image reinterpretation : towards cooperative human-computer creativity , 1999 .

[144]  Choong-ho Yi,et al.  Modelling object-oriented dynamic systems using a logic-based framework , 2002 .

[145]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[146]  Mikael Kindborg,et al.  Concurrent comics : programming of social agents by children , 2003 .

[147]  Jørgen Staunstrup.  Specification and Verification of Concurrent Programs , 1979 .

[148]  Hermann Kopetz,et al.  Distributed fault-tolerant real-time systems: the Mars approach , 1989, IEEE Micro.

[149]  Olof Johansson.  Development environments for complex product models , 1996 .

[150]  Marco Spuri,et al.  Scheduling aperiodic tasks in dynamic priority systems , 1996, Real-Time Systems.

[151]  Aleksandra Tesanovic,et al.  Developing Reusable and Reconfigurable Real-Time Software using Aspects and Components , 2006 .

[152]  Henrik Nilsson,et al.  Declarative debugging for lazy functional languages , 1998 .

[153]  Wang Yi,et al.  On Clock Difference Constraints and Termination in Reachability Analysis of Timed Automata , 2003, ICFEM.

[154]  Carl-Johan Petri,et al.  Organizational information provision : managing mandatory and discretionary utilization of information technology , 2001 .

[155]  Traian Pop,et al.  Analysis and Optimisation of Distributed Embedded Systems with Heterogeneous Scheduling Policies , 2007 .

[156]  Tarja Susi.  The puzzle of social activity: the significance of tools in cognition and cooperation , 2006 .

[157]  Magnus Merkel,et al.  Understanding and enhancing translation by parallel text processing , 1999 .

[158]  A. Jefferson Offutt,et al.  Mutation-based testing criteria for timeliness , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[159]  Lars Hult,et al.  Publika informationstjänster : en studie av den elektroniska encyklopedins bruksegenskaper , 2003 .

[160]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[161]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[162]  Yuxiao Zhao,et al.  Standards-based application integration for business-to-business communications , 2005 .

[163]  Robert Nilsson,et al.  A Mutation-based Framework for Automated Testing of Timeliness , 2006 .

[164]  Ansgar Fehnker,et al.  Scheduling a steel plant with timed automata , 1999, Proceedings Sixth International Conference on Real-Time Computing Systems and Applications. RTCSA'99 (Cat. No.PR00306).

[165]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[166]  Johan Åberg,et al.  Live help systems : an approach to intelligent help for Web information systems , 2002 .

[167]  Sigrid Eldh.  Software Testing Techniques , 2007 .

[168]  Ioan Chisalita,et al.  Communication and Networking Techniques for Traffic Safety Systems , 2006 .

[169]  Luis Alejandro Cortés,et al.  Verification and Scheduling Techniques for Real-Time Embedded Systems , 2005 .

[170]  Kjell Orsborn,et al.  On Extensible and Object-Relational Database Technology for Finite Element Analysis Applications , 1996 .

[171]  J. Skåmedal.  Telecommuting's implications on travel and travel patterns , 2004 .

[172]  Artur Wilk,et al.  Types for XML with Application to Xcerpt , 2008 .

[173]  Johan Fagerström,et al.  A paradigm and system for design of distributed systems , 1988 .

[174]  Mathias Broxvall,et al.  A Study in the Computational Complexity of Temporal Reasoning , 2002 .

[175]  Jonas Mellin,et al.  Resource-Predictable and Efficient Monitoring of Events , 2004 .

[176]  Ulf Nilsson,et al.  Abstract Interpretation & Abstract Machines: Contribution to a Methodology for the Implementation of Logic Programs , 1992 .

[177]  Paul Ammann,et al.  Using model checking to generate tests from specifications , 1998, Proceedings Second International Conference on Formal Engineering Methods (Cat.No.98EX241).

[178]  Mikael Lind,et al.  Från system till process kriterier för processbestämning vid verksamhetsanalys , 2001 .

[179]  Johan Bengtsson,et al.  Reducing Memory Usage in Symbolic State-Space Exploration for Timed Systems , 2001 .

[180]  Pernilla Qvarfordt,et al.  Eyes on multimodal interaction , 2004 .

[181]  Kim G. Larsen,et al.  Time-Optimal Real-Time Test Case Generation Using Uppaal , 2003, FATES.

[182]  Man Lin.  Analysis and synthesis of reactive systems : a generic layered architecture perspective , 1999 .

[183]  Iakov Nakhimovski,et al.  Contributions to the Modeling and Simulation of Mechanical Systems with Detailed Contact Analyses , 2006 .

[184]  Wang Yi,et al.  Uppaal in a nutshell , 1997, International Journal on Software Tools for Technology Transfer.

[185]  Wang Yi,et al.  UPPAAL - Now, Next, and Future , 2000, MOVEP.

[186]  Jörgen Hansson,et al.  Value-driven multi-class overload management in real-time database systems , 1999 .

[187]  Hans Olsen,et al.  Automatic Verification of Petri Nets in a CLP Framework , 1997 .

[188]  Juha Takkinen,et al.  From information management to task management in electronic mail , 2002 .

[189]  Jeffrey M. Voas,et al.  PIE: A Dynamic Failure-Based Technique , 1992, IEEE Trans. Software Eng..

[190]  Pawel Pietrzak,et al.  A type-based framework for locating errors in constraint logic programs , 2002 .

[191]  C. Curescu,et al.  Utility-based Optimisation of Resource Allocation for Wireless Networks , 2005 .

[192]  Stefan Cronholm,et al.  Metodverktyg och användbarhet : en studie av datorstödd metodbaserad systemutveckling , 1998 .

[193]  Anders Lindström,et al.  English and other foreign linguistic elements in spoken Swedish : studies of productive processes and their modelling using finite-state tools , 2004 .

[194]  Werner Schütz.  On the testability of distributed real-time systems , 1991, [1991] Proceedings Tenth Symposium on Reliable Distributed Systems.

[195]  Tore Risch,et al.  Compilation of multiple file queries in a meta-database system , 1978 .

[196]  Mikael Cäker,et al.  Management accounting as constructing and opposing customer focus : three case studies on management accounting and customer relations , 2005 .

[197]  Per Wikberg,et al.  PhD thesis: Eliciting Knowledge from Experts in Modeling of Complex Systems: Managing Variation and Interactions. , 2022 .

[198]  Jonas Mellin,et al.  Supporting System-Level Testing of Applications by Active Real-Time Database Systems , 1997, ARTDB.

[199]  Jörgen Skågeby,et al.  Gifting Technologies: Ethnographic Studies of End-users and Social Media Sharing , 2008 .

[200]  Sape Mullender,et al.  Distributed systems , 1989 .

[201]  Johan Jenvald.  Methods and tools in computer-supported taskforce training , 1999 .

[202]  Jonas Mellin,et al.  Bounds on test effort for event-triggered real-time systems , 1999, Proceedings Sixth International Conference on Real-Time Computing Systems and Applications. RTCSA'99 (Cat. No.PR00306).

[203]  Anders Arpteg,et al.  Intelligent Semi-Structured Information Extraction , 2005 .

[204]  Anneli Hagdahl,et al.  Development of IT-supported Inter-organisational Collaboration: A Case Study in the Swedish Public Sector , 2002 .

[205]  Kim G. Larsen,et al.  Guided Synthesis of Control Programs Using UPPAAL , 2000, Nord. J. Comput..

[206]  Rachida Dssouli,et al.  Communications software design for testability: specification transformations and testability measures , 1999, Inf. Softw. Technol..

[207]  Wanchai Rivepiboon,et al.  An analysis technique to increase testability of object-oriented components , 2008 .

[208]  Lars Degerstedt,et al.  Tabulation-based Logic Programming : A Multi-level View of Query Answering , 1996 .

[209]  Asmus Pandikow,et al.  A Generic Principle for Enabling Interoperability of Structured and Object-Oriented Analysis and Design Tools , 2002 .

[210]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[211]  H. Kopetz,et al.  Dependability: Basic Concepts and Terminology , 1992, Dependable Computing and Fault-Tolerant Systems.

[212]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[213]  Joachim Karlsson,et al.  A systematic approach for prioritizing software requirements , 1998 .

[214]  Mikael Ericsson,et al.  Supporting the use of design knowledge : an assessment of commenting agents , 1999 .

[215]  Wang Yi,et al.  Timed Automata: Semantics, Algorithms and Tools , 2003, Lectures on Concurrency and Petri Nets.

[216]  Pär Carlshamre,et al.  A usability perspective on requirements engineering : from methodology to product development , 2001 .

[217]  Esa Falkenroth.  Database technology for control and simulation , 2000 .

[218]  René Boel,et al.  Modular synthesis of efficient schedules in a timed discrete event plant , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[219]  Erik Anders Tengvald,et al.  The design of expert planning systems: an experimental operations planning system for turning , 1984 .

[220]  Erik Berglund,et al.  Library Communication Among Programmers Worldwide , 2002 .

[221]  Ching-Lai Hwang,et al.  Basic Concepts and Terminology , 1979 .

[222]  Jason Gait,et al.  A probe effect in concurrent programs , 1986, Softw. Pract. Exp..

[223]  Björn Johansson.  Joint control in dynamic situations , 2005 .

[224]  Frits W. Vaandrager,et al.  Distributing Timed Model Checking - How the Search Order Matters , 2000, CAV.

[225]  Vanja Josifovski,et al.  Design, implementation and evaluation of a distributed mediator system for data integration , 1999 .

[226]  Peter Bunus,et al.  Debugging techniques for equation-based languages , 2004 .

[227]  Claudiu Duma,et al.  Security and trust mechanisms for groups in distributed services , 2005 .

[228]  Roy S. Freedman,et al.  Testability of Software Components , 1991, IEEE Trans. Software Eng..

[229]  Ling Lin,et al.  Management of 1-D Sequence Data- From Discrete to Continuous , 1999 .

[230]  Fredrik Heintz,et al.  DyKnow : A Stream-Based Knowledge Processing Middleware Framework , 2009 .