计算机科学 ›› 2026, Vol. 53 ›› Issue (8): 61-70.doi: 10.11896/jsjkx.260400046

• 数据库 & 大数据 & 数据科学 • 上一篇    下一篇

基于CNN特征增强与动态稀疏级联的深度森林模型

张学毅, 闫霏霏   

  1. 青海民族大学数学与统计学院 西宁 810007
  • 收稿日期:2026-04-09 修回日期:2026-07-09 出版日期:2026-08-15 发布日期:2026-08-17
  • 通讯作者: 闫霏霏(ffyan_cn@163.com)
  • 作者简介:(1748560582@qq.com)
  • 基金资助:
    青海省自然科学基金面上项目(2025-ZJ-953M)

Deep Forest Models Based on CNN Feature Enhancement and Dynamic Sparse Cascading

ZHANG Xueyi, YAN Feifei   

  1. College of Mathematics and Statistics, Qinghai Minzu University, Xining 810007, China
  • Received:2026-04-09 Revised:2026-07-09 Published:2026-08-15 Online:2026-08-17
  • About author:ZHANG Xueyi,born in 2000,postgra-duate.His main research interest is distributed computing.
    YAN Feifei,born in 1982,Ph.D,asso-ciate professor.Her main research in-terest is dimension reduction for high-dimensional data.
  • Supported by:
    Natural Science Foundation of Qinghai Province(2025-ZJ-953M).

摘要: 针对原始深度森林多粒度扫描计算冗余、级联森林特征维度膨胀导致的效率低下问题,提出一种基于卷积神经网络(CNN)特征增强与动态稀疏级联的深度森林模型CDS-Forest。该模型采用轻量级卷积神经网络CNN替代计算密集的多粒度扫描,实现高效的层次化特征提取;同时,引入动态稀疏级联机制,通过特征选择自适应控制模型复杂度,从而避免特征冗余。在MNIST和CIFAR-10两个基准数据集上的实验表明,CDS-Forest在MNIST数据集上准确率达99.14%,显著高于原始gcForest的96.28%和标准CNN的98.75%,训练时间仅为gcForest的1/112;在CIFAR-10数据集上CDS-Forest的准确率达88.76%,比标准CNN、gcForest分别高0.48个百分点和4.1个百分点,训练时间仅为gcForest的1/62、标准CNN的1/3。CDS-Forest模型对硬件设备配置要求宽松,无需高性能图像处理器即可高效运行,具有经济友好性强、部署成本低的优势。所提出的模型为图像分类任务提供了一种高效、易用且设备要求低的非神经网络深度模型方案,丰富了深度学习与集成学习的融合思路。

关键词: 深度森林, CNN特征增强, 动态稀疏级联, 图像分类, 特征提取

Abstract: To address the computational redundancy of multi-granularity scanning and the efficiency loss caused by feature dimension expansion in the original deep forest framework,this paper proposes a novel deep forest model-CDS-Forest-based on CNN feature enhancement and dynamic sparse cascading.The proposed model utilizes a lightweight convolutional neural network(CNN) for efficient hierarchical feature extraction,effectively replacing the computationally intensive multi-granularity scanning module.Furthermore,a dynamic sparse cascading mechanism is introduced to adaptively control model complexity and eliminate feature redundancy through selective feature integration.Experimental results on two benchmark datasets,MNIST and CIFAR-10,demonstrate the superiority of CDS-Forest.On the MNIST dataset,it achieves an accuracy of 99.14%,significantly outperforming the original gcForest(96.28%) and standard CNN(98.75%),while its training time is only 1/112 of gcForest.On the CIFAR-10 dataset,CDS-Forest achieves an accuracy of 88.76%,which is 0.48 percentage points and 4.1 percentage points higher than standard CNN and gcForest,respectively,with the training time reduced to 1/62 of gcForest and 1/3 of standard CNN.CDS-Forest model exhibits low hardware dependency and operates efficiently without high-performance GPUs,offering a cost-effective and low-deployment-cost solution.This work provides an efficient,user-friendly,and hardware-light non-neural deep learning alternative for image classification,enriching the integration of deep learning and ensemble methods.

Key words: Deep forest, CNN feature enhancement, Dynamic sparse cascading, Image classification, Feature extraction

中图分类号: 

  • TP181
[1] ZHOU Z H,FENG J.Deep Forest:Towards an Alternative to Deep Neural Networks[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence.IJCAI,2017:3553-3559.
[2] PANG M,TING K M,ZHAO P,et al.Improving Deep Forest by Confidence Screening[C]//2018 IEEE International Conference on Data Mining(ICDM).IEEE,2018:1194-1199.
[3] ZHU G,HU Q,GU R,et al.ForestLayer:Efficient training of deep forests on distributed task-parallel platforms[J].Journal of Parallel and Distributed Computing,2019,132:113-126.
[4] BOUALLEG Y,FARAH M,FARAH I R.Remote sensingscene classification using convolutional features and deep forest classifier[J].IEEE Geoscience and Remote Sensing Letters,2019,16(12):1944-1948.
[5] LV Q,FENG W,QUAN Y,et al.Enhanced-random-feature-subspace-based ensemble CNN for the imbalanced hyperspectral image classification[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2021,14:3988-3999.
[6] ZHANG X,WANG J,XU J,et al.Detection of android malware based on deep forest and feature enhancement[J].IEEE Access,2023,11:29344-29359.
[7] SUN L,MO Z,YAN F,et al.Adaptive feature selection guided deep forest for COVID-19 classification with chest CT[J].IEEE Journal of Biomedical and Health Informatics,2020,24(10):2798-2805.
[8] MING Y,SHAO H,CAI B,et al.rgfc-Forest:An enhanced deep forest method towards small-sample fault diagnosis of electromechanical system[J].Expert Systems with Applications,2024,238:122178.
[9] SHAO H,MING Y,LIU Y,et al.Small sample gearbox fault di-agnosis based on improved deep forest in noisy environments[J].Nondestructive Testing and Evaluation,2025,40(8):3935-3956.
[10] LIU Q J,CHEN Q,YANG Y X.Prediction model of traffic accident severity based on PSO-XGBoost-MLP-RF Stacking integration[J/OL].Journal of Safety and Environment,1-12[2026-07-08].https://doi.org/10.13637/j.issn.1009-6094.2025.1859.
[11] DING W Z,RAN R S,HU Z C.Fault diagnosis based on multi-branch CNN and improved cascade forest[J].Journal of Shihezi University(Natural Science Edition),2025,43(2):239-248.
[12] XU X,WEN X K,WANG W J.Partially ordered deep forestmodel based on feature fusion[J].Computer Engineering and Applications,2025,61(7):165-175.
[13] ZHANG Y,ZHOU J,ZHENG W,et al.Distributed Deep Forest and its Application to Automatic Detection of Cash-Out Fraud[J].ACM Transactions on Intelligent Systems and Technology,2019,10(5):1-19.
[14] LIU P,WANG X,YIN L,et al.Flat random forest:a new ensemble learning method towards better training efficiency and adaptive model size to deep forest[J].International Journal of Machine Learning and Cybernetics,2020,11(11):2501-2513.
[15] XIE W,LI Z,XU Y,et al.Evaluation of different bearing fault classifiers in utilizing CNN feature extraction ability[J].Sensors,2022,22(9):3314.
[16] BI Y,XUE B,ZHANG M.Evolving deep forest with automatic feature extraction for image classification using genetic programming[C]//Proceedings of International Conference on Parallel Problem Solving from Nature.Cham:Springer,2020:3-18.
[17] CAO X,WEN L,GE Y,et al.Rotation-based deep forest for hyperspectral imagery classification[J].IEEE Geoscience and Remote Sensing Letters,2019,16(7):1105-1109.
[18] QIN X,XU D,DONG X,et al.The fault diagnosis of rolling bearing based on improved deep forest[J].Shock and Vibration,2021,2021:9933137.
[19] CHENG J,CHEN M,LI C,et al.Emotion recognition frommulti-channel EEG via deep forest[J].IEEE Journal of Biomedical and Health Informatics,2020,25(2):453-464.
[20] YAO N,CHENG K.Electric power equipment image recognition based on deep forest learning model with few samples[C]//Journal of Physics:Conference Series.Bristol:IOP Publishing,2021:012025.
[21] CHEN H W,SHANG D W,ZHANG X,et al.Application research of credit fraud detection based on distributed rotation deep forest[J].Intelligent Data Analysis,2024,28(4):1067-1091.
[22] YUAN Z,ZHANG Y,YU Y,et al.Improving distributed systems failure prediction via multi-objective feature selection and deep forest[J].International Journal of Intelligent Networks,2025,6:151-165.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!