计算机科学 ›› 2026, Vol. 53 ›› Issue (8): 61-70.doi: 10.11896/jsjkx.260400046
张学毅, 闫霏霏
ZHANG Xueyi, YAN Feifei
摘要: 针对原始深度森林多粒度扫描计算冗余、级联森林特征维度膨胀导致的效率低下问题,提出一种基于卷积神经网络(CNN)特征增强与动态稀疏级联的深度森林模型CDS-Forest。该模型采用轻量级卷积神经网络CNN替代计算密集的多粒度扫描,实现高效的层次化特征提取;同时,引入动态稀疏级联机制,通过特征选择自适应控制模型复杂度,从而避免特征冗余。在MNIST和CIFAR-10两个基准数据集上的实验表明,CDS-Forest在MNIST数据集上准确率达99.14%,显著高于原始gcForest的96.28%和标准CNN的98.75%,训练时间仅为gcForest的1/112;在CIFAR-10数据集上CDS-Forest的准确率达88.76%,比标准CNN、gcForest分别高0.48个百分点和4.1个百分点,训练时间仅为gcForest的1/62、标准CNN的1/3。CDS-Forest模型对硬件设备配置要求宽松,无需高性能图像处理器即可高效运行,具有经济友好性强、部署成本低的优势。所提出的模型为图像分类任务提供了一种高效、易用且设备要求低的非神经网络深度模型方案,丰富了深度学习与集成学习的融合思路。
中图分类号:
| [1] ZHOU Z H,FENG J.Deep Forest:Towards an Alternative to Deep Neural Networks[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence.IJCAI,2017:3553-3559. [2] PANG M,TING K M,ZHAO P,et al.Improving Deep Forest by Confidence Screening[C]//2018 IEEE International Conference on Data Mining(ICDM).IEEE,2018:1194-1199. [3] ZHU G,HU Q,GU R,et al.ForestLayer:Efficient training of deep forests on distributed task-parallel platforms[J].Journal of Parallel and Distributed Computing,2019,132:113-126. [4] BOUALLEG Y,FARAH M,FARAH I R.Remote sensingscene classification using convolutional features and deep forest classifier[J].IEEE Geoscience and Remote Sensing Letters,2019,16(12):1944-1948. [5] LV Q,FENG W,QUAN Y,et al.Enhanced-random-feature-subspace-based ensemble CNN for the imbalanced hyperspectral image classification[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2021,14:3988-3999. [6] ZHANG X,WANG J,XU J,et al.Detection of android malware based on deep forest and feature enhancement[J].IEEE Access,2023,11:29344-29359. [7] SUN L,MO Z,YAN F,et al.Adaptive feature selection guided deep forest for COVID-19 classification with chest CT[J].IEEE Journal of Biomedical and Health Informatics,2020,24(10):2798-2805. [8] MING Y,SHAO H,CAI B,et al.rgfc-Forest:An enhanced deep forest method towards small-sample fault diagnosis of electromechanical system[J].Expert Systems with Applications,2024,238:122178. [9] SHAO H,MING Y,LIU Y,et al.Small sample gearbox fault di-agnosis based on improved deep forest in noisy environments[J].Nondestructive Testing and Evaluation,2025,40(8):3935-3956. [10] LIU Q J,CHEN Q,YANG Y X.Prediction model of traffic accident severity based on PSO-XGBoost-MLP-RF Stacking integration[J/OL].Journal of Safety and Environment,1-12[2026-07-08].https://doi.org/10.13637/j.issn.1009-6094.2025.1859. [11] DING W Z,RAN R S,HU Z C.Fault diagnosis based on multi-branch CNN and improved cascade forest[J].Journal of Shihezi University(Natural Science Edition),2025,43(2):239-248. [12] XU X,WEN X K,WANG W J.Partially ordered deep forestmodel based on feature fusion[J].Computer Engineering and Applications,2025,61(7):165-175. [13] ZHANG Y,ZHOU J,ZHENG W,et al.Distributed Deep Forest and its Application to Automatic Detection of Cash-Out Fraud[J].ACM Transactions on Intelligent Systems and Technology,2019,10(5):1-19. [14] LIU P,WANG X,YIN L,et al.Flat random forest:a new ensemble learning method towards better training efficiency and adaptive model size to deep forest[J].International Journal of Machine Learning and Cybernetics,2020,11(11):2501-2513. [15] XIE W,LI Z,XU Y,et al.Evaluation of different bearing fault classifiers in utilizing CNN feature extraction ability[J].Sensors,2022,22(9):3314. [16] BI Y,XUE B,ZHANG M.Evolving deep forest with automatic feature extraction for image classification using genetic programming[C]//Proceedings of International Conference on Parallel Problem Solving from Nature.Cham:Springer,2020:3-18. [17] CAO X,WEN L,GE Y,et al.Rotation-based deep forest for hyperspectral imagery classification[J].IEEE Geoscience and Remote Sensing Letters,2019,16(7):1105-1109. [18] QIN X,XU D,DONG X,et al.The fault diagnosis of rolling bearing based on improved deep forest[J].Shock and Vibration,2021,2021:9933137. [19] CHENG J,CHEN M,LI C,et al.Emotion recognition frommulti-channel EEG via deep forest[J].IEEE Journal of Biomedical and Health Informatics,2020,25(2):453-464. [20] YAO N,CHENG K.Electric power equipment image recognition based on deep forest learning model with few samples[C]//Journal of Physics:Conference Series.Bristol:IOP Publishing,2021:012025. [21] CHEN H W,SHANG D W,ZHANG X,et al.Application research of credit fraud detection based on distributed rotation deep forest[J].Intelligent Data Analysis,2024,28(4):1067-1091. [22] YUAN Z,ZHANG Y,YU Y,et al.Improving distributed systems failure prediction via multi-objective feature selection and deep forest[J].International Journal of Intelligent Networks,2025,6:151-165. |
|
||