Image recognition based on deep learning

Deep learning is a multilayer neural network learning algorithm which emerged in recent years. It has brought a new wave to machine learning, and making artificial intelligence and human-computer interaction advance with big strides. We applied deep learning to handwritten character recognition, and explored the two mainstream algorithm of deep learning: the Convolutional Neural Network (CNN) and the Deep Belief NetWork (DBN). We conduct the performance evaluation for CNN and DBN on the MNIST database and the real-world handwritten character database. The classification accuracy rate of CNN and DBN on the MNIST database is 99.28% and 98.12% respectively, and on the real-world handwritten character database is 92.91% and 91.66% respectively. The experiment results show that deep learning does have an excellent feature learning ability. It don't need to extract features manually. Deep learning can learn more nature features of the data.

[1]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[2]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[3]  David Bouchain.  Character Recognition Using Convolutional Neural Networks , 2006 .

[4]  Li Zhuo,et al.  Extreme Weather Recognition Using Convolutional Neural Networks , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[5]  Shuo Wang,et al.  Overview of deep learning , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[6]  Ragheb Walid,et al.  Handwritten digit recognition using sparse deep architectures , 2014, 2014 9th International Conference on Intelligent Systems: Theories and Applications (SITA-14).

[7]  Jia Lei,et al.  Deep Learning: Yesterday, Today, and Tomorrow , 2013 .

[8]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[9]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[10]  Ruihua Zhao,et al.  Research and Development of Deep Learning , 2017 .

[11]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[12]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[13]  Christian Igel,et al.  An Introduction to Restricted Boltzmann Machines , 2012, CIARP.

[14]  Sehn Chun.  Handwritten Character Recognition Using Principal Component Analysis , 2005 .

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.