Topic-aware Web Service Representation Learning

The advent of Service-Oriented Architecture (SOA) has brought a fundamental shift in the way in which distributed applications are implemented. An overwhelming number of Web-based services (e.g., APIs and Mashups) have leveraged this shift and furthered development. Applications designed with SOA principles are typically characterized by frequent dependencies with one another in the form of heterogeneous networks, i.e., annotation relations between tags and services, and composition relations between Mashups and APIs. Although prior work has shown the utility gained by exploring these networks, their analysis is still in its infancy. This article develops an approach to learning representations of the Web service network, which seeks to embed Web services in low-dimensional continuous vectors with preserved information of the network structure, functional tags, and service descriptions, such that services with similar functional properties and network structures are mapped together in the learned latent space. We first propose a topic generative model for constructing two topic distribution networks (Mashup-Topic and API-Topic) from the service content. Then, we present an efficient optimization process to derive low-dimensional vector representations of Web services from a tri-layer bipartite network with the Mashup-Topic and API-Topic networks on two ends and the Mashup-API composition network in the middle. Experiments on real-word datasets have verified that our approach is effective to learn robust low-rank service representations, i.e., 25% F1-measure gain over the state-of-the-art in Web service recommendation task.

[1]  Mingdong Tang,et al.  Integrated Content and Network-Based Service Clustering and Web APIs Recommendation for Mashup Development , 2020, IEEE Transactions on Services Computing.

[2]  Bo Cheng,et al.  Lightweight Service Mashup Middleware With REST Style Architecture for IoT Applications , 2018, IEEE Transactions on Network and Service Management.

[3]  Zhiyuan Liu,et al.  Max-Margin DeepWalk: Discriminative Learning of Network Representation , 2016, IJCAI.

[4]  Zibin Zheng,et al.  A Weighted Meta-graph Based Approach for Mobile Application Recommendation on Heterogeneous Information Networks , 2018, ICSOC.

[5]  Aixin Sun,et al.  Topic Modeling for Short Texts with Auxiliary Word Embeddings , 2016, SIGIR.

[6]  Yanchun Zhang,et al.  Web Services Discovery Based on Latent Semantic Approach , 2008, 2008 IEEE International Conference on Web Services.

[7]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[8]  Jiang Guo,et al.  A General Framework for Content-enhanced Network Representation Learning , 2016, ArXiv.

[9]  Zhen Wang,et al.  Knowledge Graph and Text Jointly Embedding , 2014, EMNLP.

[10]  Jiafeng Guo,et al.  BTM: Topic Modeling over Short Texts , 2014, IEEE Transactions on Knowledge and Data Engineering.

[11]  Mingdong Tang,et al.  Domain-aware Mashup service clustering based on LDA topic model from multiple data sources , 2017, Inf. Softw. Technol..

[12]  Bo Cheng,et al.  Semantics Mining & Indexing-based Rapid Web Services Discovery Framework , 2018 .

[13]  Pan Hui,et al.  Understanding Cross-site Linking in Online Social Networks , 2014, SNAKDD'14.

[14]  Pan Hui,et al.  Understanding Cross-Site Linking in Online Social Networks , 2018, ACM Trans. Web.

[15]  Michael Eickenberg,et al.  Machine learning for neuroimaging with scikit-learn , 2014, Front. Neuroinform..

[16]  Lina Yao,et al.  Unified Collaborative and Content-Based Web Service Recommendation , 2015, IEEE Transactions on Services Computing.

[17]  Buqing Cao,et al.  A Prior Knowledge Based Approach to Improving Accuracy of Web Services Clustering , 2018, 2018 IEEE International Conference on Services Computing (SCC).

[18]  Schahram Dustdar,et al.  A vector space search engine for Web services , 2005, Third European Conference on Web Services (ECOWS'05).

[19]  Mohamed Quafafou,et al.  Probabilistic Topic Models for Web Services Clustering and Discovery , 2013, ESOCC.

[20]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[21]  Michael Q. Zhang,et al.  Network embedding-based representation learning for single cell RNA-seq data , 2017, Nucleic acids research.

[22]  Chengqi Zhang,et al.  Tri-Party Deep Network Representation , 2016, IJCAI.

[23]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[24]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[25]  Huan Liu,et al.  Multi-Layered Network Embedding , 2018, SDM.

[26]  Nicola Fanizzi,et al.  Adaptive Knowledge Propagation in Web Ontologies , 2017, ACM Trans. Web.

[27]  Valeria De Antonellis,et al.  WISeR , 2017, ACM Trans. Web.

[28]  Chengqi Zhang,et al.  Network Representation Learning: A Survey , 2017, IEEE Transactions on Big Data.

[29]  Rongxing Lu,et al.  Securing the Internet of Things in a Quantum World , 2017, IEEE Communications Magazine.

[30]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[31]  Mingdong Tang,et al.  WE-LDA: A Word Embeddings Augmented LDA Model for Web Services Clustering , 2017, 2017 IEEE International Conference on Web Services (ICWS).

[32]  Hailong Sun,et al.  A Novel Approach for API Recommendation in Mashup Development , 2014, 2014 IEEE International Conference on Web Services.

[33]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[34]  Zhaochun Ren,et al.  Multi-Dimensional Network Embedding with Hierarchical Structure , 2018, WSDM.

[35]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[36]  Freddy Lécué,et al.  Semantic content-based recommendation of software services using context , 2013, TWEB.

[37]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[38]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[39]  Hady Wirawan Lauw,et al.  Probabilistic Latent Document Network Embedding , 2014, 2014 IEEE International Conference on Data Mining.

[40]  Jianfeng Ma,et al.  Attribute-Based Keyword Search over Hierarchical Data in Cloud Computing , 2020, IEEE Transactions on Services Computing.

[41]  Jianxun Liu,et al.  A Topic-Sensitive Method for Mashup Tag Recommendation Utilizing Multi-Relational Service Data , 2021, IEEE Transactions on Services Computing.

[42]  Bo Cheng,et al.  LSMP: A Lightweight Service Mashup Platform for Ordinary Users , 2017, IEEE Communications Magazine.

[43]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[44]  Patrick C. K. Hung,et al.  Constructing a Global Social Service Network for Better Quality of Web Service Discovery , 2015, IEEE Transactions on Services Computing.

[45]  Zibin Zheng,et al.  Modeling and exploiting tag relevance for Web service mining , 2013, Knowledge and Information Systems.

[46]  Ming Gao,et al.  BiNE: Bipartite Network Embedding , 2018, SIGIR.

[47]  Yee Whye Teh,et al.  A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation , 2006, NIPS.

[48]  Xuanjing Huang,et al.  Incorporate Group Information to Enhance Network Embedding , 2016, CIKM.

[49]  Zhiyuan Liu,et al.  Fast Network Embedding Enhancement via High Order Proximity Approximation , 2017, IJCAI.

[50]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[51]  Xiangnan He,et al.  Attributed Social Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[52]  Klaus Moessner,et al.  Probabilistic Methods for Service Clustering , 2010, SMRR@ISWC.

[53]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.