Computer Science ›› 2022, Vol. 49 ›› Issue (12): 312-318.doi: 10.11896/jsjkx.211200036

• Artificial Intelligence • Previous Articles     Next Articles

Re-lightweight Method of MobileNet Based on Low-cost Deformable Convolution

SUN Chang-di, PAN Zhi-song, ZHANG Yan-yan   

  1. College of Command and Control Engineering,Army Engineering University of PLA,Nanjing 210007,China
  • Received:2021-12-02 Revised:2022-05-12 Published:2022-12-14
  • About author:SUN Chang-di,born in 1991,postgra-duate.His main research interests include artificial intelligence and pattern recognition.PAN Zhi-song,born in 1973,Ph.D,professor,Ph.D supervisor.His main research interests include artificial intelligence and pattern recognition.
  • Supported by:
    National Natural Science Foundation of China(62076251).

Abstract: In recent years,with the development of unmanned driving,intelligent UAV and mobile Internet,the demand for lightweight neural network from low-power,low-cost mobile and embedded platforms is increasingly urgent.Based on the idea of deformable convolution and depthwise separable convolution,this paper presents a low-cost deformable convolution,which has the advantages of high-efficiency feature extraction ability of deformable convolution and low computational complexity of depthwise separable convolution.In addition,on the basis of applying low-cost deformable convolution and combining with the method of model structure compression,4 lightweight methods of MobileNet network are designed.Experiments on Caltech256,CIFAR100 and CIFAR10 datasets demonstrate that low-cost deformable convolution can effectively improve the classification accuracy of lightweight networks without significant increase in computational effort.Besides,the accuracy of the MobileNet network can be improved by 0.4%~1% by combining the 4 MobileNet re-lightening methods in this paper,while the network computing load can be reduced by 5% ~ 15%,which significantly improves the performance of the lightweight network and better meets the practical needs of low power consumption and low computing power.It has very important practical significance for the advancement of intelligence in the field of mobile and embedded platforms.

Key words: Low-cost deformable convolution, Deformable convolution, Depthwise separable convolution, MobileNet, Lightweight, Image classification

CLC Number: 

  • TP391.4
[1]SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[J].arXiv:1409.1556,2014.
[2]HE K,ZHANG X,REN S,et al.Deep Residual Learning forImage Recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2016.
[3]PENGCHENG B I,LUO J,CHEN W,et al.Research on Lightweight Convolutional Neural Network Technology[J/OL].http://en.cnki.com.cn/Article_en/CJFDTotal-JSGG201916005.htm.
[4]CHENG Y,WANG D,ZHOU P,et al.A Survey of Model Compression and Acceleration for Deep Neural Networks[J].arXiv:1710.09282,2017.
[5]IANDOLA F N,HAN S,MOSKEWICZ M W,et al.Squeeze-Net:AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size[J].arXiv:1602.07360,2016.
[6]HOWARD A G,ZHU M,CHEN B,et al.MobileNets:Efficient Convolutional Neural Networks for Mobile Vision Applications[J].arXiv:1704.04861,2017.
[7]ZHANG X,ZHOU X,LIN M,et al.ShuffleNet:An Extremely Efficient Convolutional Neural Network for Mobile Devices[J].arXiv:1707.01083,2017.
[8]DENG L,LI G,HAN S,et al.Model Compression and Hardware Acceleration for Neural Networks:A Comprehensive Survey[J].Proceedings of the IEEE,2020,108(4):485-532.
[9]DAI J,QI H,XIONG Y,et al.Deformable Convolutional Net-works[C]//Proceedings of the IEEE International Conference on Computer Vision.Venice,2017:764-773..
[10]CHEN F,WU F,XU J,et al.Adaptive deformable convolutional network[J/OL].https://www.researchgate.net/publication/346289132_Adaptive_deformable_convolutional_network.
[11]ZUO Z,ZHANG W,ZHANG D,et al.A remote sensing image semantic segmentation method by combining deformable convolution with conditional random fields[J].Acta Geodaetica et Cartographica Sinica,2020,3(3):39-49.
[12]ZHANG Y F.Lightweight of deep learning and its application in image recognition[D].Jinhua:Zhejiang Teachers’ University,2019.
[13]HE Y,ZHANG X,SUN J.Channel Pruning for AcceleratingVery Deep Neural Networks[C]//2017 IEEE International Conference onComputer Vision(ICCV).2017:1398-1406.
[14]GUO J,LI Y,LIN W,et al.Network Decoupling:From Regular to Depthwise Separable Convolutions[J].arXiv:1808.05517,2018.
[15]SUN W,ZHOU X,ZHANG X,et al.A Lightweight NeuralNetwork Combining Dilated Convolution and Depthwise Separable Convolution[C/OL]// 2020.https://link.springer.com/chapter/10.1007/978-3-030-48513-9_17.
[16]GRIFFIN G,HOLUB A,PERONA P.Caltech-256 Object Category Dataset[R].Pasadena(Los Angeles,USA):Caltech Technical Report,2007.
[1] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[2] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[3] HAO Qiang, LI Jie, ZHANG Man, WANG Lu. Spatial Non-cooperative Target Components Recognition Algorithm Based on Improved YOLOv3 [J]. Computer Science, 2022, 49(6A): 358-362.
[4] DU Li-jun, TANG Xi-lu, ZHOU Jiao, CHEN Yu-lan, CHENG Jian. Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning [J]. Computer Science, 2022, 49(6A): 60-65.
[5] ZHU Xu-dong, XIONG Yun. Study on Multi-label Image Classification Based on Sample Distribution Loss [J]. Computer Science, 2022, 49(6): 210-216.
[6] PENG Yun-cong, QIN Xiao-lin, ZHANG Li-ge, GU Yong-xiang. Survey on Few-shot Learning Algorithms for Image Classification [J]. Computer Science, 2022, 49(5): 1-9.
[7] ZHANG Wen-xuan, WU Qin. Fine-grained Image Classification Based on Multi-branch Attention-augmentation [J]. Computer Science, 2022, 49(5): 105-112.
[8] XU Hua-jie, CHEN Yu, YANG Yang, QIN Yuan-zhuo. Semi-supervised Learning Method Based on Automated Mixed Sample Data Augmentation Techniques [J]. Computer Science, 2022, 49(3): 288-293.
[9] DONG Lin, HUANG Li-qing, YE Feng, HUANG Tian-qiang, WENG Bin, XU Chao. Survey on Generalization Methods of Face Forgery Detection [J]. Computer Science, 2022, 49(2): 12-30.
[10] TIAN Tian-yi, SUN Fu-ming. Tumor Recognition Method Based on Domain Adaptive Algorithm [J]. Computer Science, 2022, 49(12): 250-256.
[11] ZHANG Xi-ke, MA Zhi-qing, ZHAO Wen-hua, CUI Dong-mei. Review on Classification of Breast Cancer Histopathological Images Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(11A): 210800232-9.
[12] YUAN Hui-lin, LIU Jun-tao, HUANG Bi, HAN Zhen, FENG Chong. Classification Method of Harmful Garbage Images Based on Improved EfficientNetV2 [J]. Computer Science, 2022, 49(11A): 211100100-5.
[13] HE Peng-hao, YU Ying, XU Chao-yue. Image Super-resolution Reconstruction Network Based on Dynamic Pyramid and Subspace Attention [J]. Computer Science, 2022, 49(11A): 210900202-8.
[14] CHEN Jin-ling, CHENG Mao-kai, XU Zi-han. Improved FCOS Target Detection Algorithm [J]. Computer Science, 2022, 49(11A): 210900220-6.
[15] Abudukelimu ABULIZI, ZHANG Yu-ning, Alimujiang YASEN, GUO Wen-qiang, Abudukelimu HALIDANMU. Survey of Research on Extended Models of Pre-trained Language Models [J]. Computer Science, 2022, 49(11A): 210800125-12.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!