Application of Memory Reduction into Environmentally Invariant Regressor CNN

In recent years, the need for computer vision applications such as object/scene classification has grown rapidly. For example, tracking of vehicles and recognizing number plates can be used to automatically estimate traffic flow. These applications require high environmental invariance due to weather conditions, illumination changes, etc.) as well as compact design and fast rocessing speed in order to be deployed into edge devices. In this paper, we consider the regression problem for vehicle’s number plate recognition. It is shown in [1] that recognition accuracy increases if letters/digits are geometrically transformed beforehand to fix distortions or mis-alignments. However, using CNN to realize such regression task requires a large nunber of parameters. We propose to use low-rank approximation and fine-tuning to reduce the size of such CNNs. Experiments show that under various environments, our method is effective in greatly reducing memory consumption without significantly degrading performance.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Joan Bruna,et al.  Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation , 2014, NIPS.

[3]  Yifan Gong,et al.  Restructuring of deep neural network acoustic models with singular value decomposition , 2013, INTERSPEECH.

[4]  Hanqing Lu,et al.  Recent advances in efficient computation of deep convolutional neural networks , 2018, Frontiers of Information Technology & Electronic Engineering.

[5]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.