A new class of convolutional neural networks (SICoNNets) and their application of face detection

Artificial neural networks (ANNs), evolved from biological insights, have equipped computers with the capacity to actually learn from examples using real world data. With this remarkable ability, ANNs are able to extract patterns and detect trends that are too complex to be noticed or perceived by either humans or classical computer techniques. Nevertheless, as the amount of data to be processed increases significantly there is a demand for developing other types of artificial neural networks to perform complex pattern recognition tasks. In this article, a new class of convolutional neural networks, namely shunting inhibitory convolutional neural networks (SICoNNets), is introduced, and a training algorithm is developed using supervised learning based on resilient backpropagation with momentum. Three different network topologies, ranging from fully-connected to partially-connected, are implemented and trained to discriminate between face and non-face patterns. All three architectures achieve more than 96% correct face classification; the best architecture achieves 97.6% correct face classification at a false alarm rate of 3.4%.

[1]  Ah Chung Tsoi,et al.  An evaluation of the neocognitron , 1997, IEEE Trans. Neural Networks.

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[4]  Takayuki Ito,et al.  Neocognitron: A neural network model for a mechanism of visual pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Abdesselam Bouzerdoum A new class of high-order neural networks with nonlinear decision boundaries , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[6]  Abdesselam Bouzerdoum,et al.  Application of shunting inhibitory artificial neural networks to medical diagnosis , 2001, The Seventh Australian and New Zealand Intelligent Information Systems Conference, 2001.

[7]  Christophe Garcia,et al.  A neural architecture for fast and robust face detection , 2002, Object recognition supported by user interaction for service robots.

[8]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  R. B. Pinter,et al.  Shunting inhibitory cellular neural networks: derivation and stability analysis , 1993 .

[10]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.