Computer Science ›› 2026, Vol. 53 ›› Issue (8): 61-70.doi: 10.11896/jsjkx.260400046

• Database & Big Data & Data Science • Previous Articles     Next Articles

Deep Forest Models Based on CNN Feature Enhancement and Dynamic Sparse Cascading

ZHANG Xueyi, YAN Feifei   

  1. College of Mathematics and Statistics, Qinghai Minzu University, Xining 810007, China
  • Received:2026-04-09 Revised:2026-07-09 Online:2026-08-15 Published:2026-08-17
  • About author:ZHANG Xueyi,born in 2000,postgra-duate.His main research interest is distributed computing.
    YAN Feifei,born in 1982,Ph.D,asso-ciate professor.Her main research in-terest is dimension reduction for high-dimensional data.
  • Supported by:
    Natural Science Foundation of Qinghai Province(2025-ZJ-953M).

Abstract: To address the computational redundancy of multi-granularity scanning and the efficiency loss caused by feature dimension expansion in the original deep forest framework,this paper proposes a novel deep forest model-CDS-Forest-based on CNN feature enhancement and dynamic sparse cascading.The proposed model utilizes a lightweight convolutional neural network(CNN) for efficient hierarchical feature extraction,effectively replacing the computationally intensive multi-granularity scanning module.Furthermore,a dynamic sparse cascading mechanism is introduced to adaptively control model complexity and eliminate feature redundancy through selective feature integration.Experimental results on two benchmark datasets,MNIST and CIFAR-10,demonstrate the superiority of CDS-Forest.On the MNIST dataset,it achieves an accuracy of 99.14%,significantly outperforming the original gcForest(96.28%) and standard CNN(98.75%),while its training time is only 1/112 of gcForest.On the CIFAR-10 dataset,CDS-Forest achieves an accuracy of 88.76%,which is 0.48 percentage points and 4.1 percentage points higher than standard CNN and gcForest,respectively,with the training time reduced to 1/62 of gcForest and 1/3 of standard CNN.CDS-Forest model exhibits low hardware dependency and operates efficiently without high-performance GPUs,offering a cost-effective and low-deployment-cost solution.This work provides an efficient,user-friendly,and hardware-light non-neural deep learning alternative for image classification,enriching the integration of deep learning and ensemble methods.

Key words: Deep forest, CNN feature enhancement, Dynamic sparse cascading, Image classification, Feature extraction

CLC Number: 

  • TP181
[1] ZHOU Z H,FENG J.Deep Forest:Towards an Alternative to Deep Neural Networks[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence.IJCAI,2017:3553-3559.
[2] PANG M,TING K M,ZHAO P,et al.Improving Deep Forest by Confidence Screening[C]//2018 IEEE International Conference on Data Mining(ICDM).IEEE,2018:1194-1199.
[3] ZHU G,HU Q,GU R,et al.ForestLayer:Efficient training of deep forests on distributed task-parallel platforms[J].Journal of Parallel and Distributed Computing,2019,132:113-126.
[4] BOUALLEG Y,FARAH M,FARAH I R.Remote sensingscene classification using convolutional features and deep forest classifier[J].IEEE Geoscience and Remote Sensing Letters,2019,16(12):1944-1948.
[5] LV Q,FENG W,QUAN Y,et al.Enhanced-random-feature-subspace-based ensemble CNN for the imbalanced hyperspectral image classification[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2021,14:3988-3999.
[6] ZHANG X,WANG J,XU J,et al.Detection of android malware based on deep forest and feature enhancement[J].IEEE Access,2023,11:29344-29359.
[7] SUN L,MO Z,YAN F,et al.Adaptive feature selection guided deep forest for COVID-19 classification with chest CT[J].IEEE Journal of Biomedical and Health Informatics,2020,24(10):2798-2805.
[8] MING Y,SHAO H,CAI B,et al.rgfc-Forest:An enhanced deep forest method towards small-sample fault diagnosis of electromechanical system[J].Expert Systems with Applications,2024,238:122178.
[9] SHAO H,MING Y,LIU Y,et al.Small sample gearbox fault di-agnosis based on improved deep forest in noisy environments[J].Nondestructive Testing and Evaluation,2025,40(8):3935-3956.
[10] LIU Q J,CHEN Q,YANG Y X.Prediction model of traffic accident severity based on PSO-XGBoost-MLP-RF Stacking integration[J/OL].Journal of Safety and Environment,1-12[2026-07-08].https://doi.org/10.13637/j.issn.1009-6094.2025.1859.
[11] DING W Z,RAN R S,HU Z C.Fault diagnosis based on multi-branch CNN and improved cascade forest[J].Journal of Shihezi University(Natural Science Edition),2025,43(2):239-248.
[12] XU X,WEN X K,WANG W J.Partially ordered deep forestmodel based on feature fusion[J].Computer Engineering and Applications,2025,61(7):165-175.
[13] ZHANG Y,ZHOU J,ZHENG W,et al.Distributed Deep Forest and its Application to Automatic Detection of Cash-Out Fraud[J].ACM Transactions on Intelligent Systems and Technology,2019,10(5):1-19.
[14] LIU P,WANG X,YIN L,et al.Flat random forest:a new ensemble learning method towards better training efficiency and adaptive model size to deep forest[J].International Journal of Machine Learning and Cybernetics,2020,11(11):2501-2513.
[15] XIE W,LI Z,XU Y,et al.Evaluation of different bearing fault classifiers in utilizing CNN feature extraction ability[J].Sensors,2022,22(9):3314.
[16] BI Y,XUE B,ZHANG M.Evolving deep forest with automatic feature extraction for image classification using genetic programming[C]//Proceedings of International Conference on Parallel Problem Solving from Nature.Cham:Springer,2020:3-18.
[17] CAO X,WEN L,GE Y,et al.Rotation-based deep forest for hyperspectral imagery classification[J].IEEE Geoscience and Remote Sensing Letters,2019,16(7):1105-1109.
[18] QIN X,XU D,DONG X,et al.The fault diagnosis of rolling bearing based on improved deep forest[J].Shock and Vibration,2021,2021:9933137.
[19] CHENG J,CHEN M,LI C,et al.Emotion recognition frommulti-channel EEG via deep forest[J].IEEE Journal of Biomedical and Health Informatics,2020,25(2):453-464.
[20] YAO N,CHENG K.Electric power equipment image recognition based on deep forest learning model with few samples[C]//Journal of Physics:Conference Series.Bristol:IOP Publishing,2021:012025.
[21] CHEN H W,SHANG D W,ZHANG X,et al.Application research of credit fraud detection based on distributed rotation deep forest[J].Intelligent Data Analysis,2024,28(4):1067-1091.
[22] YUAN Z,ZHANG Y,YU Y,et al.Improving distributed systems failure prediction via multi-objective feature selection and deep forest[J].International Journal of Intelligent Networks,2025,6:151-165.
[1] LIU Yanze, HAN Bo, YUAN Jidong, SU Dongliang, REN Jia, CAI Zhiming, WANG Zhihai. Anomaly Detection in Time Series Based on Time-Frequency Contrastive Learning [J]. Computer Science, 2026, 53(8): 20-28.
[2] FENG Haoyu, ZHANG Yuxuan, LIU Zixuan, MENG Hua. Network Anomaly Traffic Detection Based on Deep Multi-instance Learning [J]. Computer Science, 2026, 53(8): 426-436.
[3] JIANG Lingla, CHEN Wen, SUN Wei, ZHAO Kui. Research on Deep Learning-based Side-channel Analysis Method with Dynamically ComposableMulti-head Attention [J]. Computer Science, 2026, 53(8): 437-445.
[4] ZHU Bin, LI Xiaobin. AETC:Image Classification Model via Attention-based Topological Features Fusion [J]. Computer Science, 2026, 53(7): 24-33.
[5] ZHANG Yan, ZHOU Jian, HAN Lei, CHENG Chunling. Gate-controlled Agent Attention Mechanism-based Soft Prompt Transfer Method [J]. Computer Science, 2026, 53(7): 139-145.
[6] ZHANG Shouyi, SHEN Qiang, GUO Yiran, WANG Hanyu. Rain and Fog Weather Object Detection Algorithm Based on Improved YOLOv8 Model [J]. Computer Science, 2026, 53(6A): 250300090-7.
[7] DUAN Pengsong, LUO Yu, WANG Chao. Q&A Model for Agricultural Diseases Based on Transformer [J]. Computer Science, 2026, 53(6A): 250400114-9.
[8] YAO Ye, GUO Kangning, ZHU Yian, LIAO Shaochun, ZHANG Ni. Research on Health Evaluation Technology of AHP-FEC Meteorological Equipment Based onLasso Optimization [J]. Computer Science, 2026, 53(6A): 250400123-16.
[9] GUO Jingchen, YANG Kuiwu, DING Mengdi, WEI Jianghong. Survey of Adversarial Sample Attacks for Vision Transformer [J]. Computer Science, 2026, 53(5): 404-418.
[10] MENG Siyu, NIU Chunxiang, TAN Quange, WANG Rong. Deepfake Detection Method Based on Positional Enhancement and Frequency Domain ComponentInteraction [J]. Computer Science, 2026, 53(4): 445-453.
[11] ZHENG Yi, JIA Xinghao, ZHANG Junwen, REN Shuang. Image Classification Based on Hybrid Quantum-Classical Long-Short Range Feature Extension Network [J]. Computer Science, 2026, 53(4): 277-283.
[12] CHEN Han, XU Zefeng, JIANG Jiu, FAN Fan, ZHANG Junjian, HE Chu, WANG Wenwei. Large Language Model and Deep Network Based Cognitive Assessment Automatic Diagnosis [J]. Computer Science, 2026, 53(3): 41-51.
[13] ZHAO Binbei, ZHU Li, ZHAO Hongli, LI Yutong. Computer Vision Applications in Rail Transit Systems [J]. Computer Science, 2026, 53(3): 214-224.
[14] GUO Xingxing, XIAO Yannan, WEN Peizhi, XU Zhi, HUANG Wenming. Attention-based Audio-driven Digital Face Video Generation Method [J]. Computer Science, 2026, 53(2): 245-252.
[15] LI Mengxi, GAO Xindan, LI Xue. Two-way Feature Augmentation Graph Convolution Networks Algorithm [J]. Computer Science, 2025, 52(7): 127-134.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!