计算机科学 ›› 2025, Vol. 52 ›› Issue (11A): 241000134-7.doi: 10.11896/jsjkx.241000134

• 人工智能 • 上一篇    下一篇

基于剪枝算法优化的轻量级深度学习网络算法

仇丹丹   

  1. 濮阳职业技术学院数学与信息工程学院 河南 濮阳 457000
  • 出版日期:2025-11-15 发布日期:2025-11-10
  • 通讯作者: 仇丹丹(1783505731@qq.com)
  • 基金资助:
    河南省2020年重点研发与推广专项(科技攻关)项目(212102210081)

Lightweight Deep Learning Network Algorithm Optimized Based on Pruning Algorithm

QIU Dandan   

  1. Department of Mathematics and Engineering,Puyang Vocation Technology College,Puyang,Henan 457000,China
  • Online:2025-11-15 Published:2025-11-10
  • Supported by:
    Special Project of Key R&D and Promotion in Henan Province in 2020(212102210081).

摘要: 随着目前计算机技术的不断发展,很多计算机技术都使用了智能算法来提高自身的智能化水平。其中,轻量化深度学习网络算法是使用频率较高的一种,很多领域中都使用了该算法来提高自身的生产效率。但现在的轻量级深度学习网络算法还存在算法规模大、特征提取效果差等缺点。为了解决上述问题,文中以深度网络学习算法中的一维卷积神经网络算法为研究对象,利用剪枝算法对卷积神经网络算法进行轻量化设计,以期优化算法的性能。首先将轻量化后的卷积神经网络算法与传统的算法进行对比,结果显示,轻量化算法的速度提升了近3倍,达到了3.7 bps,与此同时,算法的存储需求和能源消耗大幅度降低,能源消耗仅有12.3%。然后,将剪枝算法轻量化后的卷积神经网络学习算法与其他轻量化算法进行对比,结果表明,该算法对不同数据的平均检测精度均为95%以上,远高于其他算法,该算法的特征提取效果也显著优于其他算法,且该算法的运行耗时仅需4.98 ms,远低于其他算法。由上述结果可知,所提出的剪枝算法轻量化设计方法可以提高深度学习网络算法的各项性能。

关键词: 深度学习网络算法, 剪枝算法, 轻量化, 卷积神经网络

Abstract: With the continuous development of computer technology,many computer technologies have used intelligent algorithms to improve their intelligence level.Among them,lightweight deep learning network algorithms are one of the most frequently used,and many fields have used this algorithm to improve their production efficiency.However,current lightweight deep learning network algorithms still have drawbacks such as large algorithm scale and poor feature extraction performance.In order to solve the above problems,this study focuses on the One-dimensional convolutional neural network algorithm in deep network learning algorithms,and uses pruning algorithms to design lightweight convolutional neural network algorithms in order to optimize their performance.The study first compared the lightweight convolutional neural network algorithm with traditional algorithms,and the results showed that the speed of the lightweight algorithm was improved by nearly three times,reaching 3.7bps.At the same time,the storage requirements and energy consumption of the algorithm were significantly reduced,with energy consumption only 12.3%.Comparing the lightweight convolutional neural network learning algorithm of pruning algorithm with other lightweight algorithms,the results show that the average detection accuracy of this algorithm for different data is over 95%,far higher than other algorithms.The feature extraction effect of this algorithm is also significantly better than other algorithms,and the running time of this algorithm is only 4.98ms,far lower than other algorithms.From the above results,it can be concluded that the proposed pruning algorithm lightweight design method can improve the performance of deep learning network algorithms.

Key words: Deep learning network algorithm, Pruning algorithm, Lightweight, CNN

中图分类号: 

  • TP391
[1]SUN S,MENG Z M,HU Z W,et al.Application of multi-scale and lightweight CNN in SAR image-based surface feature classification[J].Remote Sensing for Land & Resources,2023,35(1):27-34.
[2]MAO K X,XIE Y H.Research on Audio Scene RecognitionBased on Lightweight Convolutional Neural Network[J].Computer Science and Application,2023,13(5):995-1005.
[3]YE Z X,LIU M Q,ZHANG S L.Small-scale defect detection in industrial environment based on lightweight deep learning network[J].Control and Decision,2023,38(5):1231-1238.
[4]GU W J,DING C,GAI X L,et al.Automatic Grouping Method of Flue-cured Tobacco Based on MobileViT[J].Chinese Tobacco Science,2024,45(1):104-111.
[5]ZHENG Y H,HUANG D Q.Lightweight vehicle detection network based on MobileViT and YOLOv4[J].Electronic Measurement Technology,2023,46(2):175-183.
[6]GAN W X,ZHANG Y Y,LI X Y.A Lightweight CNN Modeling Method for Building Detection from Aerial Images[J].Geospatial Information,2023,21(6):24-27.
[7]LI X B,XUE C B,DAI Y Q,et al.An Intelligent DetectionMethod of Astronomical Transients Based on Lightweight CNN Model[J].Chinese Journal of Space Science,2023,43(1):112-118.
[8]LIU Y C,ZHANG B,WANG X Q,et al.Research on real-time detection algorithm of ship fire based on lightweight CNN[J].Fire Science and Technology,2023,42(1):42-46.
[9]YE H,ZHANG B,CHEN T,et al.Performance-aware approximation of global channel pruning for multitask cnns[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2023,45(8):10267-10284.
[10]QIU B,SUN M M,CUI S L.Energy-Saving Scheduling Algorithm for Multi-Variable Neighborhood Based on Pruning Optimization[J].Journal of Applied Sciences,2022,40(2):349-360.
[11]XU X S,WANG Y F,HUA Z X,et al.Light-weight recognition network for dairy cows based on the fusion of YOLOv5s and channel pruning algorithm[J].Transactions of the Chinese Society of Agricultural Engineering(Transactions of the CSAE),2023,39(15):152-162.
[12]GAO Y Y,YU Z H,DU F.Unlabeled network pruning algorithm based on Bayesian optimization[J].Journal of Computer Applications,2023,43(1):30-36.
[13]XIE Z X,ZOU X M,ZHANG W J.High-Efficient Parameter-Pruning Algorithm of Decision Tree for Large Dataset[J].Computer Engineering,2024,50(1):156-165.
[14]WENG J H,QIN Y F,TANG X F,et al.Lane line detectionmodel pruning algorithm based on multi-objective optimization[J].Transducer and Microsystem Technologies,2023,42(7):125-127.
[15]LIU S Q,KUANG H X,YANG H C.Light-Weighted Marine Radar Target Detection Based on CFAR-CNN[J].Radar Science and Technology,2024,22(3):312-320.
[16]HOU X H,JIA X F,ZHAO B T.Lightweight recognition algorithm for OCT images of fundus lesions[J].Journal of Zhejiang University:Engineering Science,2023,57(12):2448-2455.
[17]DABLAIN D,JACOBSON K N,BELLINGER C,et al.Understanding CNN fragility when learning with imbalanced data[J].Machine Learning,2024,113(7):4785-4810.
[18]LIU H Y,ZHANG L M,YAN W J,et al.LDPC decoding based on WBP-CNN algorithm[J].Systems Engineering and Electronics,2022,44(3):1030-1035.
[19]ZHANG J Y,KOU J Q,LIU N Z.Deep Convolutional Neural Networks Pruning Algorithm Based on Filter Pruning via Distribution Fitting[J].Computer Technology and Development,2022,32(12):136-141.
[20]WANG G d,YE J,XIE Y,et al.Structured Pruning Algorithm with Adaptive Threshold Based on Gradient[J].Computer Engineering,2022,48(9):113-120.
[21]XIE S F.Research on image classification based on Xception and transfer learning[J].Modern omputer,2024,30(1):75-78.
[22]PORNPANVATTANA A,LERTAKKAKORN M,POOK-PANICH P,et al.YouTube thumbnail design recommendation systems using image-tabular multimodal data for Thai’s YouTube thumbnail[J].Social Network Analysis and Mining,2024,14(1):1-15.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!