With the development of the integrated circuit and computer science, people become caring more about solving practical issues via information technologies. Along with that, a new subject called Artificial Intelligent (AI) comes up. One popular research interest of AI is about recognition algorithm. In this paper, one of the most common algorithms, Convolutional Neural Networks (CNNs) will be introduced, for image recognition. Understanding its theory and structure is of great significance for every scholar who is interested in this field. Convolution Neural Network is an artificial neural network which combines the mathematical method of convolution and neural network. The hieratical structure of CNN provides it reliable computer speed and reasonable error rate. The most significant characteristics of CNNs are feature extraction, weight sharing and dimension reduction. Meanwhile, combining with the Back Propagation (BP) mechanism and the Gradient Descent (GD) method, CNNs has the ability to self-study and in-depth learning. Basically, BP provides an opportunity for backwardfeedback for enhancing reliability and GD is used for self-training process. This paper mainly discusses the CNN and the related BP and GD algorithms, including the basic structure and function of CNN, details of each layer, the principles and features of BP and GD, and some examples in practice with a summary in the end.
[1]
Geoffrey E. Hinton,et al.
Learning internal representations by error propagation
,
1986
.
[2]
H. Giebel,et al.
Feature Extraction and Recognition of Handwritten Characters by Homogeneous Layers
,
1971
.
[3]
Jayanth Koushik.
Understanding Convolutional Neural Networks
,
2016,
ArXiv.
[4]
Kunihiko Fukushima,et al.
Cognitron: A self-organizing multilayered neural network
,
1975,
Biological Cybernetics.
[5]
Lawrence D. Jackel,et al.
Backpropagation Applied to Handwritten Zip Code Recognition
,
1989,
Neural Computation.