A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm

There is an increasing unstructured text data produced in cross-enterprise social interaction media, forming a social interaction context that contains massive manufacturing relationships, which can be potentially used as decision support information for cross-enterprise manufacturing demand-capability matchmaking. How to enable decision-makers to capture these relationships remains a challenge. The text-based context contains high levels of noise and irrelevant information, causing both highly complexity and sparsity. Under this circumstance, instead of exploiting man-made features carefully optimized for the relationship extraction task, a deep learning model based on an improved stacked denoising auto-encoder on sentence-level features is proposed to extract manufacturing relationships among various named entities (e.g., enterprises, products, demands, and capabilities) underlying the text-based context. Experiment results show that the proposed approach can achieve a comparable performance with the state-of-the-art learning models, as well as a good practicality of its' web-based implementation in social manufacturing interaction context. The ultimate goal of this study is to facilitate knowledge transferring and sharing in the context of enterprise social interaction, thereby supporting the integration of the resources and capabilities among different enterprises.

[1]  Frans Coenen,et al.  Text classification using graph mining-based feature extraction , 2010 .

[2]  Yoshua Bengio,et al.  Exploring Strategies for Training Deep Neural Networks , 2009, J. Mach. Learn. Res..

[3]  Yudong Zhang,et al.  Automated classification of brain images using wavelet-energy and biogeography-based optimization , 2016, Multimedia Tools and Applications.

[4]  R. Amalraj,et al.  A work point count system coupled with back-propagation for solving double dummy bridge problem , 2015, Neurocomputing.

[5]  Aldo Gangemi,et al.  Ontology Design Patterns , 2005 .

[6]  Pingyu Jiang,et al.  Implementing of a three-phase integrated decision support model for parts machining outsourcing , 2014 .

[7]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[8]  Yudong Zhang,et al.  Fruit classification using computer vision and feedforward neural network , 2014 .

[9]  Xijin Tang,et al.  Using ontology to improve precision of terminology extraction from documents , 2009, Expert Syst. Appl..

[10]  Wei Cao,et al.  Cloud Machining Community for Social Manufacturing , 2012 .

[11]  Gerhard Weikum,et al.  Combining linguistic and statistical analysis to extract relations from web documents , 2006, KDD '06.

[12]  Geoffrey E. Hinton,et al.  A Scalable Hierarchical Distributed Language Model , 2008, NIPS.

[13]  Yoshua Bengio,et al.  Word Representations: A Simple and General Method for Semi-Supervised Learning , 2010, ACL.

[14]  Omar López-Ortega,et al.  A formal framework to integrate express data models in an extended enterprise context , 2007, J. Intell. Manuf..

[15]  George Forman,et al.  An Extensive Empirical Study of Feature Selection Metrics for Text Classification , 2003, J. Mach. Learn. Res..

[16]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[17]  Chunyun Zhang,et al.  Construction of semantic bootstrapping models for relation extraction , 2015, Knowl. Based Syst..

[18]  David A. Smith,et al.  Improving NLP through Marginalization of Hidden Syntactic Structure , 2012, EMNLP-CoNLL.

[19]  Ralph Grishman,et al.  Distant Supervision for Relation Extraction with an Incomplete Knowledge Base , 2013, NAACL.

[20]  Arno Scharl,et al.  Enriching semantic knowledge bases for opinion mining in big data applications , 2014, Knowl. Based Syst..

[21]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[22]  Dazhong Wu,et al.  Cloud-based design and manufacturing systems: A social network analysis , 2013 .

[23]  Zellig S. Harris,et al.  Mathematical structures of language , 1968, Interscience tracts in pure and applied mathematics.

[24]  J. Browne,et al.  The extended enterprise-a context for manufacturing , 1998 .

[25]  Aron Culotta,et al.  Dependency Tree Kernels for Relation Extraction , 2004, ACL.

[26]  B. Agard,et al.  Data-mining-based methodology for the design of product families , 2004 .

[27]  Daniel Jurafsky,et al.  Distant supervision for relation extraction without labeled data , 2009, ACL.

[28]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[29]  Xin Yao,et al.  Evolutionary Artificial Neural Networks , 1993, Int. J. Neural Syst..

[30]  Yudong Zhang,et al.  Feed‐forward neural network optimized by hybridization of PSO and ABC for abnormal brain detection , 2015, Int. J. Imaging Syst. Technol..

[31]  Dejing Dou,et al.  Chain Based RNN for Relation Classification , 2015, NAACL.

[32]  Ronen Feldman,et al.  Book Reviews: The Text Mining Handbook: Advanced Approaches to Analyzing Unstructured Data by Ronen Feldman and James Sanger , 2008, CL.

[33]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[34]  Huan Liu,et al.  Subspace clustering for high dimensional data: a review , 2004, SKDD.

[35]  Kesheng Wang,et al.  Applying data mining to manufacturing: the nature and implications , 2007, J. Intell. Manuf..

[36]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[37]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[38]  Rohini K. Srihari,et al.  A Text Mining Model for Hypothesis Generation , 2007 .

[39]  Marc'Aurelio Ranzato,et al.  Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Alexander E. Ellinger,et al.  Demand and supply integration: a conceptual framework of value creation through knowledge management , 2010 .

[41]  Joel Nothman,et al.  Learning multilingual named entity recognition from Wikipedia , 2013, Artif. Intell..

[42]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[43]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[44]  Guodong Zhou,et al.  Kernel-based semantic relation detection and classification via enriched parse tree structure , 2011 .

[45]  Alexander K. Seewald,et al.  Lambda pruning: an approximation of the string subsequence kernel for practical SVM classification and redundancy clustering , 2007, Adv. Data Anal. Classif..

[46]  Dunja Mladenic,et al.  Data Sparsity Issues in the Collaborative Filtering Framework , 2005, WEBKDD.

[47]  Abdelwadood Mesleh,et al.  Chi Square Feature Extraction Based Svms Arabic Language Text Categorization System , 2007 .

[48]  S. C. Hui,et al.  Data mining for customer service support , 2000, Inf. Manag..

[49]  Bahman Javadi,et al.  Editorial: recent advances in communication networks and multimedia technologies , 2013, Multimedia Tools and Applications.

[50]  Michael D. Gordon,et al.  Literature-based discovery by lexical statistics , 1999 .

[51]  Jun Zhao,et al.  Relation Classification via Convolutional Deep Neural Network , 2014, COLING.