An Extensive Survey on Some Deep-Learning Applications

Deep learning prospered as a distinct era of research and fragment of a wider family of machine learning, based on a set of algorithms that strengthen to model high-level abstractions in data. It tries to imitate the human intellect and learns from complicated input data and resolve different types of difficult and complex tasks. Because of Deep Learning, it was successful to deal with different input data types such as text, sound, and images in various fields. Improvement in deep-learning research has already influenced the search for speech recognition, automatic navigation systems, parallel computations, image processing, ImageNet, natural language processing, representation learning, Google translate, etc. Here, we present a review of DL and its applications including the recent development in natural language processing (NLP).

[1]  Yang Wang,et al.  Recognizing human actions from still images with latent poses , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Amaury Lendasse,et al.  Discriminant document embeddings with an extreme learning machine for classifying clinical narratives , 2018, Neurocomputing.

[3]  Michael J. Quinn,et al.  Parallel programming in C with MPI and OpenMP , 2003 .

[4]  Hayder Radha,et al.  Deep learning algorithm for autonomous driving using GoogLeNet , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[5]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[6]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[7]  Pokkuluri Kiran Sree,et al.  Investigating an Artificial Immune System to strengthen protein structure prediction and protein coding region identification using the Cellular Automata classifier , 2009, Int. J. Bioinform. Res. Appl..

[8]  Sebastian Ramos,et al.  Detecting unexpected obstacles for self-driving cars: Fusing deep learning and geometric modeling , 2016, 2017 IEEE Intelligent Vehicles Symposium (IV).

[9]  Dong-Hong Ji,et al.  A topic-enhanced word embedding for Twitter sentiment classification , 2016, Inf. Sci..

[10]  J. Fernando Sánchez-Rada,et al.  Enhancing deep learning sentiment analysis with ensemble techniques in social applications , 2020 .

[11]  Ming Zhou,et al.  Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification , 2014, ACL.

[12]  Yoshua Bengio,et al.  A Neural Probabilistic Language Model , 2003, J. Mach. Learn. Res..

[13]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[14]  Sandeep Paul,et al.  A review on advances in deep learning , 2015, 2015 IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (WCI).

[15]  Juha Karhunen,et al.  Advances in Independent Component Analysis and Learning Machines , 2015 .

[16]  Yoshua Bengio,et al.  Exploring Strategies for Training Deep Neural Networks , 2009, J. Mach. Learn. Res..

[17]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[18]  Pokkuluri Kiran Sree,et al.  A Fast Multiple Attractor Cellular Automata with Modified Clonal Classifier Promoter Region Prediction in Eukaryotes , 2014 .

[19]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[20]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[21]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[22]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Alex Krizhevsky,et al.  One weird trick for parallelizing convolutional neural networks , 2014, ArXiv.

[24]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[25]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[26]  Alessandro Moschitti,et al.  Twitter Sentiment Analysis with Deep Convolutional Neural Networks , 2015, SIGIR.

[27]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[28]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[29]  Vijay V. Raghavan,et al.  Deep Learning for Natural Language Processing , 2013 .

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Jun Guo,et al.  An empirical convolutional neural network approach for semantic relation classification , 2016, Neurocomputing.

[32]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[33]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[34]  Athena Vakali,et al.  Sentiment analysis leveraging emotions and word embeddings , 2017 .

[35]  Ramesh Babu,et al.  Identification of Promoter Region in Genomic DNA Using Cellular Automata Based Text Clustering , 2010, Int. Arab J. Inf. Technol..

[36]  Pokkuluri Kiran Sree,et al.  A Fast Multiple Attractor Cellular Automata with Modified Clonal Classifier for Coding Region Prediction in Human Genome , 2014 .