Machine learning-based incremental learning in interactive domain modelling

In domain modelling, practitioners manually transform informal requirements written in natural language (problem descriptions) to more concise and analyzable domain models expressed with class diagrams. With automated domain modelling support using existing approaches, manual modifications may still be required in extracted domain models and problem descriptions to make them more accurate and concise. For example, educators teaching software engineering courses at universities usually use an incremental approach to build modelling exercises to restrict students in using intended modelling patterns. These modifications result in the evolution of domain modelling exercises over time. To assist practitioners in this evolution, a synergy between interactive support and automated domain modelling is required. In this paper, we propose a bot-assisted approach to allow practitioners perform domain modelling quickly and interactively. Furthermore, we provide an incremental learning strategy empowered by machine learning to improve the accuracy of the bot's suggestions and extracted domain models by analyzing practitioners' decisions over time. We evaluate the performance of our bot using test problem descriptions which shows that practitioners can expect to get useful support from the bot when applied to exercises of similar size and complexity, with precision, recall, and F2 scores over 85%. Finally, we evaluate our incremental learning strategy where we observe a reduction in the required manual modifications by 70% and an improvement of F2 scores of extracted domain models by 4.2% when using our proposed approach and learning strategy together.

[1]  Jin L. C. Guo,et al.  Automated, interactive, and traceable domain modelling empowered by artificial intelligence , 2022, Software and Systems Modeling.

[2]  Claudenir M. Fonseca,et al.  UFO: Unified Foundational Ontology , 2021, Appl. Ontology.

[3]  Jörg Kienzle,et al.  Automated Traceability for Domain Modelling Decisions Empowered by Artificial Intelligence , 2021, 2021 IEEE 29th International Requirements Engineering Conference (RE).

[4]  Jörg Kienzle,et al.  DoMoBOT: A Modelling Bot for Automated and Traceable Domain Modelling , 2021, 2021 IEEE 29th International Requirements Engineering Conference (RE).

[5]  Houari Sahraoui,et al.  Recommending metamodel concepts during modeling activities with pre-trained language models , 2021, Software and Systems Modeling.

[6]  Jörg Kienzle,et al.  DoMoBOT: a bot for automated and interactive domain modelling , 2020, MoDELS.

[7]  Jörg Kienzle,et al.  Towards Queryable and Traceable Domain Models , 2020, 2020 IEEE 28th International Requirements Engineering Conference (RE).

[8]  Jörg Kienzle,et al.  A Neural Network Based Approach to Domain Modelling Relationships and Patterns Recognition , 2020, 2020 IEEE Tenth International Model-Driven Requirements Engineering (MoDRE).

[9]  Nelly Bencomo,et al.  Opportunities in intelligent modeling assistance , 2020, Software and Systems Modeling.

[10]  Nelly Bencomo,et al.  RaM: Causally-Connected and Requirements-Aware Runtime Models using Bayesian Learning , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS).

[11]  Sébastien Gérard,et al.  An LSTM-Based Neural Network Architecture for Model Transformations , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS).

[12]  Maxime Savary-Leblanc,et al.  Improving MBSE Tools UX with AI-Empowered Software Assistants , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C).

[13]  Juan de Lara,et al.  Collaborative Modeling and Group Decision Making Using Chatbots in Social Networks , 2018, IEEE Software.

[14]  Juan de Lara,et al.  The rise of the (modelling) bots: Towards assisted modelling via social networks , 2017, 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE).

[15]  Omer Salih Dawood,et al.  From Requirements Engineering to UML using Natural Language Processing – Survey Study , 2017, European Journal of Engineering and Technology Research.

[16]  Hanêne Ben-Abdallah,et al.  An UML class recommender system for software design , 2016, 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA).

[17]  Mehrdad Sabetzadeh,et al.  Extracting domain models from natural-language requirements: approach and industrial evaluation , 2016, MoDELS.

[18]  Sjaak Brinkkemper,et al.  Automated Extraction of Conceptual Models from User Stories via NLP , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[19]  Juan de Lara,et al.  An Extensible Meta-Modelling Assistant , 2016, 2016 IEEE 20th International Enterprise Distributed Object Computing Conference (EDOC).

[20]  Franklin Ramalho,et al.  A Content-Based Approach for Recommending UML Sequence Diagrams , 2016, SEKE.

[21]  Kanad K. Biswas,et al.  From natural language requirements to UML class diagrams , 2015, 2015 IEEE Second International Workshop on Artificial Intelligence for Requirements Engineering (AIRE).

[22]  Walter F. Tichy,et al.  From requirements to UML models and back: how automatic processing of text can support requirements engineering , 2013, Software Quality Journal.

[23]  Philip Samuel,et al.  Domain ontology based class diagram generation from functional requirements , 2012, 2012 12th International Conference on Intelligent Systems Design and Applications (ISDA).

[24]  Renata Pontin de Mattos Fortes,et al.  MOOGLE: a metamodel-based model search engine , 2012, Software & Systems Modeling.

[25]  Rodina Ahmad,et al.  Class Diagram Extraction from Textual Requirements Using Natural Language Processing (NLP) Techniques , 2010, 2010 Second International Conference on Computer Research and Development.

[26]  Azucena Montes Rendón,et al.  Conceptual Model Generation from Requirements Model: A Natural Language Processing Approach , 2008, NLDB.

[27]  Sébastien Gérard,et al.  An NLP-Based Architecture for the Autocompletion of Partial Domain Models , 2021, CAiSE.