The SAMBA Approach for Self-Adaptive Model-Based Online Testing of Services Orchestrations

Service Oriented Architecture (SOA) is a popular design pattern that allows building applications composed of loosely-coupled and autonomous services. Such services may evolve and change at runtime, often outside the control of the owner of the application. Consequently, typical validation approaches, like offline testing performed before services deployment, are necessary but not sufficient: offline testing cannot assure the correct behavior of the SOA during its execution. To cope with the evolution of services and their orchestrations, in this paper we present a Self-Adaptive Model-BAsed online testing framework called SAMBA. SAMBA aims to assess the proper behavior of a SOA during its lifecycle executing model-based online testing at runtime, under the coordination of a MAPE-K control loop. SAMBA is assessed in a case study, where its detection capability are proved through functional, mutation and fault injection tests.

[1]  Peter Fettke,et al.  Business Process Modeling Notation , 2008, Wirtschaftsinf..

[2]  Kim G. Larsen,et al.  T-UPPAAL: online model-based testing of real-time systems , 2004, Proceedings. 19th International Conference on Automated Software Engineering, 2004..

[3]  Soumya Simanta,et al.  Testing in Service-Oriented Environments , 2010 .

[4]  Tao Zhang,et al.  Testing BPEL with Stream X-Machine , 2008, 2008 International Symposium on Information Science and Engineering.

[5]  A. Jefferson Offutt,et al.  Inter-class mutation operators for Java , 2002, 13th International Symposium on Software Reliability Engineering, 2002. Proceedings..

[6]  Andrea Bondavalli,et al.  A Testing Service for Lifelong Validation of Dynamic SOA , 2011, 2011 IEEE 13th International Symposium on High-Assurance Systems Engineering.

[7]  W. M. P. V. D. Aalsta,et al.  YAWL : yet another workflow language , 2015 .

[8]  Poonkavithai Kalamegam,et al.  A Survey on Testing SOA Built using Web Services , 2012 .

[9]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[10]  Sebastian VanSyckel,et al.  A survey on engineering approaches for self-adaptive systems , 2015, Pervasive Mob. Comput..

[11]  Lu Zhang,et al.  Generating Effective Test Sequences for BPEL Testing , 2009, 2009 Ninth International Conference on Quality Software.

[12]  Andreas Metzger,et al.  Enabling Proactive Adaptation through Just-in-Time Testing of Conversational Services , 2010, ServiceWave.

[13]  Paolo Arcaini,et al.  Modeling and Analyzing MAPE-K Feedback Loops for Self-Adaptation , 2015, 2015 IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems.

[14]  Mike P. Papazoglou,et al.  Service-oriented computing: concepts, characteristics and directions , 2003, Proceedings of the Fourth International Conference on Web Information Systems Engineering, 2003. WISE 2003..

[15]  Sebastian Götz,et al.  Adaptive Exchange of Distributed Partial Models@run.time for Highly Dynamic Systems , 2015, 2015 IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems.

[16]  Yong Wang,et al.  A Survey on Formal Methods for Web Service Composition , 2013, 1306.5535.

[17]  Mark Harman,et al.  Testing and verification in service‐oriented architecture: a survey , 2013, Softw. Test. Verification Reliab..

[18]  Kathryn B. Laskey,et al.  Service oriented architecture , 2009 .

[19]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[20]  Douglas C. Schmidt,et al.  Model-Driven Engineering , 2006 .

[21]  Tien-Dung Cao,et al.  Online Testing Framework for Web Services , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[22]  Stuart Kent,et al.  Model Driven Engineering , 2002, IFM.

[23]  Matjaz B. Juric,et al.  Business process execution language for web services , 2004 .

[24]  Danny Weyns,et al.  MAPE-K Formal Templates to Rigorously Design Behaviors for Self-Adaptive Systems , 2015, ACM Trans. Auton. Adapt. Syst..

[25]  A. Jefferson Offutt,et al.  MuJava: an automated class mutation system , 2005, Softw. Test. Verification Reliab..

[26]  Hye-Young Paik,et al.  Web Service Composition: Overview , 2017 .

[27]  Fatiha Zaïdi,et al.  A Formal Framework for Service Orchestration Testing Based on Symbolic Transition Systems , 2009, TestCom/FATES.

[28]  Fevzi Belli,et al.  A holistic approach to model‐based testing of Web service compositions , 2014, Softw. Pract. Exp..