Comparison of Convolutional Neural Network Models for Mobile Devices

In recent years mobile devices have become an important part of our daily lives and Deep Convolutional Neural Networks have been performing well in the task of image classification. Some considerations have to be made when running a Neural Network inside a mobile device such as computational complexity and storage size. In this paper, common architectures for image classification were analyzed to retrieve the values of accuracy rate, model complexity, memory usage, and inference time. Those values were compared and it was possible to show which architecture to choose from considering mobile restrictions.

[1]  Keiji Yanai,et al.  Efficient Mobile Implementation of A CNN-based Object Recognition System , 2016, ACM Multimedia.

[2]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Jian Cheng,et al.  Quantized CNN: A Unified Approach to Accelerate and Compress Convolutional Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[6]  Andrés García,et al.  Artificial neural networks as emulators of process-based models to analyse bathing water quality in estuaries. , 2019, Water research.

[7]  Reza Derakhshani,et al.  Multi-biometric Convolutional Neural Networks for Mobile User Authentication , 2018, 2018 IEEE International Symposium on Technologies for Homeland Security (HST).

[8]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[9]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[10]  Tian Guo,et al.  Cloud-Based or On-Device: An Empirical Study of Mobile Deep Inference , 2017, 2018 IEEE International Conference on Cloud Engineering (IC2E).

[11]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Paolo Napoletano,et al.  Benchmark Analysis of Representative Deep Neural Network Architectures , 2018, IEEE Access.

[14]  Ching-Yung Lin,et al.  Deep Convolutional Neural Network on iOS Mobile Devices , 2016, 2016 IEEE International Workshop on Signal Processing Systems (SiPS).

[15]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Owais Qayyum,et al.  IOS Mobile Application for Food and Location Image Prediction using Convolutional Neural Networks , 2018, 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences (ICETAS).

[17]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[18]  Florentin Smarandache,et al.  Smart mobile application to recognize tomato leaf diseases using Convolutional Neural Networks , 2019, 2019 International Conference of Computer Science and Renewable Energies (ICCSRE).

[19]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[21]  Bo Chen,et al.  MnasNet: Platform-Aware Neural Architecture Search for Mobile , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[23]  Shiqing Zhang,et al.  Merging-and-Evolution Networks for Mobile Vision Applications , 2018, IEEE Access.

[24]  Katja Markert,et al.  Learning Models for Object Recognition from Natural Language Descriptions , 2009, BMVC.

[25]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[26]  Franck Davoine,et al.  A baseline regularization scheme for transfer learning with convolutional neural networks , 2020, Pattern Recognit..

[27]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[28]  Phillip H. Jones,et al.  Benchmarking vision kernels and neural network inference accelerators on embedded platforms , 2020, J. Syst. Archit..