Autoencoder Alignment Approach to Run-Time Interoperability for System of Systems Engineering

We formulate the challenging problem to establish information interoperability within a system of systems (SoS) as a machine-learning task, where autoencoder embeddings are aligned using message data and metadata to automate message translation. An SoS requires communication and collaboration between otherwise independently operating systems, which are subject to different standards, changing conditions, and hidden assumptions. Thus, interoperability approaches that are based on standardization and symbolic inference will have limited generalization and scalability in the SoS engineering domain. We present simulation experiments performed with message data generated using heating and ventilation system simulations. While the unsupervised learning approach proposed here remains unsolved in general, we obtained up to 75% translation accuracy with autoencoders aligned by back-translation after investigating seven different models with different training protocols and hyperparameters. For comparison, we obtain 100% translation accuracy on the same task with supervised learning, but the need for a labeled dataset makes that approach less interesting. We discuss possibilities to extend the proposed unsupervised learning approach to reach higher translation accuracy.

[1]  Jerker Delsing,et al.  Interoperability and machine-to-machine translation model with mappings to machine learning tasks , 2019, 2019 IEEE 17th International Conference on Industrial Informatics (INDIN).

[2]  Alasdair Gilchrist Industry 4.0 , 2016, Apress.

[3]  Honglak Lee,et al.  Learning Structured Output Representation using Deep Conditional Generative Models , 2015, NIPS.

[4]  Brian J. Sauser,et al.  System of Systems - the meaning of of , 2006, 2006 IEEE/SMC International Conference on System of Systems Engineering.

[5]  Jay Lee,et al.  A Cyber-Physical Systems architecture for Industry 4.0-based manufacturing systems , 2015 .

[6]  Trevor Darrell,et al.  Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoders , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Fredrik Sandin,et al.  Semantic Interoperability in Industry 4.0: Survey of Recent Developments and Outlook , 2018, 2018 IEEE 16th International Conference on Industrial Informatics (INDIN).

[8]  Mark W. Maier Architecting Principles for Systems‐of‐Systems , 1996 .

[9]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[10]  Eleonora Borgia,et al.  The Internet of Things vision: Key features, applications and open issues , 2014, Comput. Commun..

[11]  Dimitris Kiritsis,et al.  DeepAlignment: Unsupervised Ontology Matching with Refined Word Vectors , 2018, NAACL.

[12]  Hema A. Murthy,et al.  A Generative Model for Zero Shot Learning Using Conditional Variational Autoencoders , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Emanuel Palm,et al.  Syntactic Translation of Message Payloads Between At Least Partially Equivalent Encodings , 2019, 2019 IEEE International Conference on Industrial Technology (ICIT).

[14]  Matt J. Kusner,et al.  Grammar Variational Autoencoder , 2017, ICML.

[15]  Fredrik Asplund,et al.  A systematic review to merge discourses: Interoperability, integration and cyber-physical systems , 2017, J. Ind. Inf. Integr..

[16]  Regina Barzilay,et al.  Style Transfer from Non-Parallel Text by Cross-Alignment , 2017, NIPS.

[17]  Lior Wolf,et al.  One-Shot Unsupervised Cross Domain Translation , 2018, NeurIPS.

[18]  Amit P. Sheth,et al.  The SSN ontology of the W3C semantic sensor network incubator group , 2012, J. Web Semant..

[19]  Filipe Moutinho,et al.  Extended Semantic Annotations for Generating Translators in the Arrowhead Framework , 2018, IEEE Transactions on Industrial Informatics.

[20]  Jason Lee,et al.  Fully Character-Level Neural Machine Translation without Explicit Segmentation , 2016, TACL.

[21]  Wolfgang Mahnke,et al.  OPC UA - Service-oriented Architecture for Industrial Applications , 2006, Softwaretechnik-Trends.

[22]  John Licato,et al.  Evaluating representational systems in artificial intelligence , 2017, Artificial Intelligence Review.

[23]  Peter Gärdenfors,et al.  Navigating cognition: Spatial codes for human thinking , 2018, Science.

[24]  Ruslan Salakhutdinov,et al.  Learning Robust Visual-Semantic Embeddings , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Wayne H. Wolf,et al.  Cyber-physical Systems , 2009, Computer.

[26]  Jerker Delsing IoT Automation : Arrowhead Framework , 2017 .

[27]  Jacob Nilsson,et al.  System of Systems Interoperability Machine Learning Model , 2019 .

[28]  Jerker Delsing,et al.  IoT Interoperability—On-Demand and Low Latency Transparent Multiprotocol Translator , 2017, IEEE Internet of Things Journal.