Dense short connection network for efficient image classification

With the continuous development of convolutional neural networks (CNNs), image classification technology has entered a new stage in solving visual cognition tasks. Recent advances have shown that if containing short connections, convolutional networks can be more accurate and efficient to train. However, these short connections almost only exist between convolutional layers, which potentially make the feature information flow insufficiently. In addition, the multi‐scale representation ability of CNNs using short connections can be further explored. Thus, the dense short connection network (DSCNet) for efficient image classification is designed in this paper. In DSCNet, we propose a simple yet effective architectural unit, namely dense short connection (DSC) module, which allows hierarchical dense short connections for multi‐scale context information across different feature channels within a single convolutional layer. DSCNets have several noteworthy advantages: they improve the multi‐scale representation ability, enhance feature propagation, and reduce the number of parameters. To validate our DSC, we conduct comprehensive experiments on CIFAR‐100 and Tiny ImageNet datasets. Experimental results show that DSCNets achieve very competitive results with previous baseline models, whilst requiring less computation to achieve higher recognition accuracy. Further ablation studies show that our proposed method can achieve consistent performance gains in image classification tasks.

[1]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[2]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Zhuowen Tu,et al.  Deeply Supervised Salient Object Detection with Short Connections , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Mengchu Zhou,et al.  Dynamic Embedding Projection-Gated Convolutional Neural Networks for Text Classification , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Jianwei Li,et al.  A Lightweight Convolutional Neural Network Based on Visual Attention for SAR Image Target Classification , 2018, Sensors.

[11]  Wei Gao,et al.  Color-Guided Depth Map Super-Resolution Using a Dual-Branch Multi-Scale Residual Network with Channel Interaction , 2020, Sensors.

[12]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Xiangyu Zhang,et al.  ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design , 2018, ECCV.

[15]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Jinjun Chen,et al.  Privacy preservation in blockchain based IoT systems: Integration issues, prospects, challenges, and future research directions , 2019, Future Gener. Comput. Syst..

[18]  Byung Cheol Song,et al.  MUNet: Macro Unit-Based Convolutional Neural Network for Mobile Devices , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Xiaohui Li,et al.  Multi-Scale Global Contrast CNN for Salient Object Detection , 2020, Sensors.

[20]  Xiao Liu,et al.  Do we need to handle every temporal violation in scientific workflow systems? , 2014, TSEM.

[21]  Ma,et al.  FSRFNet: Feature-Selective and Spatial Receptive Fields Networks , 2019, Applied Sciences.

[22]  Jinjun Chen,et al.  A Multicloud-Model-Based Many-Objective Intelligent Algorithm for Efficient Task Scheduling in Internet of Things , 2021, IEEE Internet of Things Journal.

[23]  Jinjun Chen,et al.  A historical probability based noise generation strategy for privacy protection in cloud computing , 2012, J. Comput. Syst. Sci..

[24]  Stanford,et al.  Tiny ImageNet Classification with Convolutional Neural Networks , 2015 .

[25]  Jinjun Chen,et al.  Trust‐based robust scheduling and runtime adaptation of scientific workflow , 2009, Concurr. Comput. Pract. Exp..

[26]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Quoc V. Le,et al.  Searching for MobileNetV3 , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[28]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Zhihua Cui,et al.  A Hybrid BlockChain-Based Identity Authentication Scheme for Multi-WSN , 2020, IEEE Transactions on Services Computing.

[30]  Xiao Liu,et al.  SwinDeW-C: A Peer-to-Peer Based Cloud Workflow System , 2010, Handbook of Cloud Computing.

[31]  Junwei Han,et al.  DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Jinjun Chen,et al.  DEAL: Differentially Private Auction for Blockchain-Based Microgrids Energy Trading , 2020, IEEE Transactions on Services Computing.

[35]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.