Convolutional Neural Networks Considering Robustness Improvement and Its Application to Face Recognition

This paper proposes a novel activation function to promote robustness to the outliers of the training samples. Data samples in the decision boundaries are weighted more by adding the derivatives of the sigmoid function outputs to avoid drastic update of the network weights. Therefore, the network becomes more robust to outliers and noisy patterns. We also present appropriate backpropagation learning algorithm for the convolutional neural networks. We evaluate the performance improvement by the proposed method on a face recognition task, and proved that it outperformed the state of art face recognition methods.

[1]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[2]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[3]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[4]  Christophe Garcia,et al.  Simplifying ConvNets for Fast Learning , 2012, ICANN.

[5]  Kai Zhang,et al.  Multi-view face identification and pose estimation using B-spline interpolation , 2005, Inf. Sci..

[6]  Li Zhuo,et al.  Extreme Weather Recognition Using Convolutional Neural Networks , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[7]  K. Manikantan,et al.  DWT based Feature Extraction using Edge Tracked Scale Normalization for Enhanced Face Recognition , 2012 .

[8]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[9]  Soo-Young Lee,et al.  Merging Back-propagation and Hebbian Learning Rules for Robust Classifications , 1996, Neural Networks.

[10]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[11]  Mohammad Teshnehlab,et al.  Hierarchical Structure Based convolutional Neural Network for Face Recognition , 2013, Int. J. Comput. Intell. Appl..

[12]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..