Oracle Bone Inscriptions information processing based on multi-modal knowledge graph

Abstract To solve the problems of the great learning difficulty, the long learning period, wide range of knowledge points but weak knowledge connection, and low sharing of Oracle Bone Studies (OBS), a solution of constructing a multi-modal knowledge graph is proposed. Because OBS research involves various kinds of modal data, and these modalities need to be combined together to solve some problems. The OBS multi-modal knowledge graph can provide a unified semantic space for multi-source heterogeneous data. Through multi-modal fusion and information complementation, the defects of a single modality in information processing can be resolved. This multi-modal knowledge graph organizes and manages the basic data better to serve Oracle Bone Inscriptions (OBI) information processing research. Taking OBI detection and recognition as examples, we studied the applications of OBS multi-modal knowledge graph. The experimental results demonstrate that the proposed method reaches 81.3% accuracy in detection and 80.43% accuracy in recognition, and it has 3.7% in detection and 14.8% in recognition improved to the conventional methods.

[1]  Yujie Li,et al.  User-Oriented Virtual Mobile Network Resource Management for Vehicle Communications , 2021, IEEE Transactions on Intelligent Transportation Systems.

[2]  David S. Rosenblum,et al.  MMKG: Multi-Modal Knowledge Graphs , 2019, ESWC.

[3]  Huimin Lu,et al.  Ternary Adversarial Networks With Self-Supervision for Zero-Shot Cross-Modal Retrieval , 2020, IEEE Transactions on Cybernetics.

[4]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[5]  Huimin Lu,et al.  Brain Intelligence: Go beyond Artificial Intelligence , 2017, Mobile Networks and Applications.

[6]  Jing Xiong,et al.  Oracle bone inscription detection: a survey of Oracle bone inscription detection based on deep learning algorithm , 2019, AIIPCC '19.

[7]  Yujie Li,et al.  Deep Fuzzy Hashing Network for Efficient Image Retrieval , 2021, IEEE Transactions on Fuzzy Systems.

[8]  Guoying Liu,et al.  Oracle Bone Inscriptions Recognition Based on Deep Convolutional Neural Network , 2020 .

[9]  Peter Bloem,et al.  End-to-End Entity Classification on Multimodal Knowledge Graphs , 2020, ArXiv.

[10]  Huimin Lu,et al.  Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[11]  Qing-Long Han,et al.  Networked control systems: a survey of trends and techniques , 2020, IEEE/CAA Journal of Automatica Sinica.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Feiran Huang,et al.  Image-text sentiment analysis via deep multimodal attentive fusion , 2019, Knowl. Based Syst..

[14]  Stefan Lee,et al.  ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks , 2019, NeurIPS.

[15]  Jing Xiong,et al.  Oracle Bone Inscriptions Big Knowledge Management and Service Platform , 2019, ICPCSEE.

[16]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[17]  Huimin Lu,et al.  Chinese Image Captioning via Fuzzy Attention-based DenseNet-BiLSTM , 2021, ACM Trans. Multim. Comput. Commun. Appl..

[18]  Huimin Lu,et al.  DRRS-BC: Decentralized Routing Registration System Based on Blockchain , 2021, IEEE/CAA Journal of Automatica Sinica.

[19]  Feng Gao,et al.  Oracle-Bone Inscription Recognition Based on Deep Convolutional Neural Network , 2018, J. Comput..

[20]  Li Fei-Fei,et al.  Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries , 2015 .

[21]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..