Test automation of a measurement system using a domain-specific modelling language

We have developed a test automation framework called SeTT integrated within a domain-specific modelling language Sequencer.SeTT supports the development of model-based tests using a high-level abstractions.We use SeTT to automatically test data acquisitions and measurement procedures.We have successfully applied SeTT in the complicated industrial environments. The construction of domain-specific modelling languages (DSMLs) is only the first step within the needed toolchain. Models need to be maintained, modified or functional errors searched for. Therefore, tool support is vital for the DSML end-user's efficiency. This paper presents SeTT, a simple but very useful tool for DSML end-users, a testing framework integrated within a DSML Sequencer. This Sequencer, part of the DEWESoft data acquisition system, supports the development of model-based tests using a high-level abstraction. The tests are used during the whole data acquisition process and able to test different systems' parts. This paper shows how high-level specifications can be extended to describe a testing infrastructure for a specific DSML. In this manner, the Sequencer and SeTT were combined at the metamodel level. The contribution of the paper is to show that one can leverage on the DSML to build a testing framework with relatively little effort, by implementing assertions to it.

[1]  Aniruddha S. Gokhale,et al.  Domain-Specific Modeling , 2008, Handbook of Dynamic System Modeling.

[2]  Andreas Krämer,et al.  Model-Based Testing of Automotive Systems , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[3]  Kalle Lyytinen,et al.  MetaEdit+: A Fully Configurable Multi-User and Multi-Tool CASE and CAME Environment , 1996, CAiSE.

[4]  Christof J. Budnik,et al.  Experiences using Tedeso: an extensible and interoperable model-based testing platform , 2012, Automated Software Engineering.

[5]  Marjan Mernik,et al.  Development of data acquisition systems by using a domain-specific modeling language , 2012, Comput. Ind..

[6]  Hui Wu,et al.  Grammar-driven generation of domain-specific language debuggers , 2008 .

[7]  Juha-Pekka Tolvanen,et al.  Domain-Specific Modeling: Enabling Full Code Generation , 2008 .

[8]  Gabor Karsai,et al.  A Configurable Visual Programming Environment: A Tool for Domain-Specific Programming , 1995, Computer.

[9]  Arie van Deursen,et al.  Domain-specific languages: an annotated bibliography , 2000, SIGP.

[10]  Gabor Karsai,et al.  Challenges and directions in formalizing the semantics of modeling languages , 2011, Comput. Sci. Inf. Syst..

[11]  Maria João Varanda Pereira,et al.  Automatic generation of language-based tools using the LISA system , 2005, IEE Proc. Softw..

[12]  Matthew Wing,et al.  Data acquisition software , 2017 .

[13]  Vinay Kulkarni,et al.  Separation of Concerns in Model-Driven Development , 2003, IEEE Softw..

[14]  Marjan Mernik,et al.  From DCOM interfaces to domain-specific modeling language: A case study on the sequencer , 2011, Comput. Sci. Inf. Syst..

[15]  Sebastian Erdweg,et al.  Language composition untangled , 2012, LDTA.

[16]  Geylani Kardas,et al.  A model driven architecture for the development of smart card software , 2014, Comput. Lang. Syst. Struct..

[17]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[18]  Jeffrey G. Gray,et al.  Domain-specific software engineering , 2010, FoSER '10.

[19]  Ed Seidewitz,et al.  What Models Mean , 2003, IEEE Softw..

[20]  Janez Brest,et al.  Design and implementation of domain-specific language easytime , 2011, Comput. Lang. Syst. Struct..

[21]  Jure Knez,et al.  A new approach to measurements: The PC instrument , 2002 .

[22]  Tim Sheard,et al.  A software engineering experiment in software component generation , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[23]  Juan A. Botía Blaya,et al.  A domain-specific language for context modeling in context-aware systems , 2013, J. Syst. Softw..

[24]  Bernhard Rumpe,et al.  Model-driven Development of Complex Software : A Research Roadmap , 2007 .

[25]  Paul Krause.  Software Test Automation: Effective Use of Test Execution Tools, Mark Fewster and Dorothy Graham, Addison-Wesley, 1999 (Book Review) , 2000, Softw. Test. Verification Reliab..

[26]  Alan Hartman,et al.  The AGEDIS tools for model based testing , 2004, ISSTA '04.

[27]  Marjan Mernik,et al.  A preliminary study on various implementation approaches of domain-specific language , 2008, Inf. Softw. Technol..

[28]  Mark Allison,et al.  Synthesizing interpreted domain-specific models to manage smart microgrids , 2014, J. Syst. Softw..

[29]  M Mernik,et al.  When and how to develop domain-specific languages , 2005, CSUR.

[30]  Douglas C. Schmidt,et al.  Guest Editor's Introduction: Model-Driven Engineering , 2006, Computer.

[31]  Don S. Batory,et al.  Multilevel models in model-driven engineering, product lines, and metaprogramming , 2006, IBM Syst. J..

[32]  Bran Selic,et al.  The Pragmatics of Model-Driven Development , 2003, IEEE Softw..

[33]  Marjan Mernik,et al.  An object-oriented approach to language compositions for software language engineering , 2013, J. Syst. Softw..

[34]  Colin Atkinson,et al.  Model-Driven Development: A Metamodeling Foundation , 2003, IEEE Softw..

[35]  Arie van Deursen,et al.  Domain-Specific Languages in Practice: A User Study on the Success Factors , 2009, MoDELS.

[36]  Stathes Hadjiefthymiades,et al.  Debugging applications created by a Domain Specific Language: The IPAC case , 2012, J. Syst. Softw..

[37]  Oscar Nierstrasz,et al.  Embedding Languages without Breaking Tools , 2010, ECOOP.

[38]  Hanspeter Mössenböck,et al.  Monaco - A domain-specific language solution for reactive process control programming with hierarchical components , 2013, Comput. Lang. Syst. Struct..

[39]  Hui Wu,et al.  Unit Testing for Domain-Specific Languages , 2009, DSL.

[40]  D. J. Lovell,et al.  NASA Tech Briefs , 1978 .

[41]  Gabor Karsai,et al.  DSLs: the good, the bad, and the ugly , 2008, OOPSLA Companion.

[42]  Jeffrey G. Gray,et al.  Debugging measurement systems using a domain-specific modeling language , 2014, Comput. Ind..

[43]  Kent L. Beck,et al.  Test-driven Development - by example , 2002, The Addison-Wesley signature series.

[44]  Alberto Rodrigues da Silva,et al.  Model-driven engineering: A survey supported by the unified conceptual model , 2015, Comput. Lang. Syst. Struct..

[45]  Gabor Karsai,et al.  The Generic Modeling Environment , 2001 .

[46]  Steven Kelly,et al.  Defining Domain-Specific Modeling Languages: Collected Experiences , 2004 .

[47]  Jeffrey C. Carver,et al.  Program comprehension of domain-specific and general-purpose languages: comparison using a family of experiments , 2011, Empirical Software Engineering.

[48]  Eelco Visser,et al.  Declaratively defining domain-specific language debuggers , 2011, GPCE '11.