A Review of the Development and Application of Natural Language Processing

With the development of convolutional neural networks and deep learning and a series of very significant breakthroughs in computer speech, many new models and methods have been provided for the field of Natural language processing. Natural language processing is a very important branch of artificial intelligence, and its application requirements and relevant fields are also becoming wider and wider. This paper first summarizes the related concepts of Natural language processing; then introduces in detail the development process of Natural language processing; then elaborates on the research progress of the application field of Natural language processing, including lexical analysis, syntactic analysis, machine translation and other fields; finally, the semantic understanding, the problem of low resources and the development direction of other fields are summarized and forecasted.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[3]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[4]  Salim Roukos,et al.  IBM's Statistical Question Answering System-TREC 11 , 2001, TREC.

[5]  H. P. Edmundson,et al.  New Methods in Automatic Extracting , 1969, JACM.

[6]  Miles Osborne,et al.  Using maximum entropy for sentence extraction , 2002, ACL 2002.

[7]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[8]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[9]  Dianne P. O'Leary,et al.  Text summarization via hidden Markov models , 2001, SIGIR '01.

[10]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[11]  Hans Peter Luhn,et al.  The Automatic Creation of Literature Abstracts , 1958, IBM J. Res. Dev..

[12]  P. Deepa Shenoy,et al.  Aspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier , 2016, World Wide Web.

[13]  Hua Wu,et al.  Improved Neural Machine Translation with SMT Features , 2016, AAAI.

[14]  Ming Zhou,et al.  Question Answering over Freebase with Multi-Column Convolutional Neural Networks , 2015, ACL.

[15]  Dianne P. O'Leary,et al.  Text Summarization via Hidden Markov Models and Pivoted QR Matrix Decomposition , 2001 .

[16]  Phil Blunsom,et al.  Recurrent Continuous Translation Models , 2013, EMNLP.

[17]  Yan Liu,et al.  Query-Oriented Multi-Document Summarization via Unsupervised Deep Learning , 2012, AAAI.