Model-Based Testing of a WAP Gateway: An Industrial Case-Study

We present experiences from a case study where a model-based approach to black-box testing is applied to verify that aWireless Application Protocol (WAP) gateway conforms to its specification. TheWAP gateway is developed by Ericsson and used in mobile telephone networks to connect mobile phones with the Internet. We focus on testing the software implementing the session (WSP) and transaction (WTP) layers of the WAP protocol. These layers, and their surrounding environment, are described as a network of timed automata. To model the many sequence numbers (from a large domain) used in the protocol, we introduce an abstraction technique. We believe the suggested abstraction technique will prove useful to model and analyse other similar protocols with sequence numbers, in particular in the context of model-based testing. A complete test bed is presented, which includes generation and execution of test cases. It takes as input a model and a coverage criterion expressed as an observer, and returns a verdict for each test case. The test bed includes existing tools from Ericsson for test-case execution. To generate test suites, we use our own tool CO/ER--a new test-case generation tool based on the real-time model-checker UPPAAL.

[1]  Kim G. Larsen,et al.  A modal process logic , 1988, [1988] Proceedings. Third Annual Information Symposium on Logic in Computer Science.

[2]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[3]  Jan Tretmans,et al.  Test Generation with Inputs, Outputs, and Quiescence , 1996, TACAS.

[4]  Gerard J. Holzmann,et al.  The Model Checker SPIN , 1997, IEEE Trans. Software Eng..

[5]  Wang Yi,et al.  Uppaal in a nutshell , 1997, International Journal on Software Tools for Technology Transfer.

[6]  Thierry Jéron,et al.  Verification and test generation for the SSCOP protocol , 2000, Sci. Comput. Program..

[7]  M. Nielsen,et al.  Application and Theory of Petri Nets 2000: 21st International Conference, ICATPN 2000 Aarhus, Denmark, June 26–30, 2000 Proceedings , 2000, ICATPN.

[8]  Jonathan Billington,et al.  Analysing the WAP Class 2 Wireless Transaction Protocol Using Coloured Petri Nets , 2000, ICATPN.

[9]  Insup Lee,et al.  A Temporal Logic Based Theory of Test Coverage and Generation , 2002, TACAS.

[10]  K. Larsen,et al.  Online Testing of Real-time Systems Using Uppaal , 2004, FATES.

[11]  Ryszard Janicki,et al.  Verification of the WAP transaction layer , 2004, Proceedings of the Second International Conference on Software Engineering and Formal Methods, 2004. SEFM 2004..

[12]  Bengt Jonsson,et al.  Specifying and Generating Test Cases Using Observer Automata , 2004, FATES.

[13]  Rajeev Alur,et al.  A Temporal Logic of Nested Calls and Returns , 2004, TACAS.

[14]  Kim G. Larsen,et al.  Testing real-time embedded software using UPPAAL-TRON: an industrial case study , 2005, EMSOFT.

[15]  Orna Kupferman,et al.  Abstraction for Falsification , 2005, CAV.

[16]  Brian Nielsen,et al.  Formal Approaches to Software Testing, 4th International Workshop, FATES 2004, Linz, Austria, September 21, 2004, Revised Selected Papers , 2005, FATES.

[17]  Sverker Holmgren,et al.  Geographical Locality and Dynamic Data Migration for OpenMP Implementations of Adaptive PDE Solvers , 2006, IWOMP.

[18]  T. Söderström,et al.  Comparison of time domain maximum likelihood method and sample maximum likelihood method in errors-in-variables identification , 2006 .

[19]  Erik Hagersten A Case for Low-Complexity Multi-CMP Architectures , 2006 .

[20]  Markus Nordén Performance modelling for parallel PDE solvers on NUMA-systems , 2006 .

[21]  Parosh Aziz Abdulla,et al.  Limiting Behavior of Markov Chains with Eager Attractors , 2006, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[22]  Owe Axelsson,et al.  Mesh Independent Superlinear PCG Rates Via Compact-Equivalent Operators , 2007, SIAM J. Numer. Anal..

[23]  Wei Xing Zheng,et al.  A Simplified Form of the Bias-Eliminating Least Squares Method for Errors-in-Variables Identification , 2007, IEEE Transactions on Automatic Control.

[24]  Torsten Söderström,et al.  Extending the Frisch scheme for errors‐in‐variables identification to correlated output noise , 2008 .

[25]  Torsten Söderström,et al.  Accuracy analysis of time-domain maximum likelihood method and sample maximum likelihood method for errors-in-variables identification , 2008 .

[26]  Stefan Engblom A discrete spectral method for the chemical master equation , 2008 .

[27]  Elisabeth Larsson,et al.  Multi-dimensional option pricing using radial basis functions and the generalized Fourier transform , 2008 .