Computer Science ›› 2022, Vol. 49 ›› Issue (6): 134-141.doi: 10.11896/jsjkx.210500119

• Database & Big Data & Data Science • Previous Articles     Next Articles

Adaptive Weight Based Broad Learning Algorithm for Cascaded Enhanced Nodes

CAI Xin-yu, FENG Xiang, YU Hui-qun   

  1. Department of Computer Science and Engineering,East China University of Science and Technology,Shanghai 200237,China
    Shanghai Smart Energy Engineering Technology Research Center,Shanghai 200237,China
  • Received:2021-05-17 Revised:2021-10-18 Online:2022-06-15 Published:2022-06-08
  • About author:CAI Xin-yu,born in 1998,postgra-duate,is a member of China Computer Federation.His main research interests include swarm intelligence and broad learning.
    FENG Xiang,born in 1977,Ph.D,professor,is a member of China Computer Federation,Her main research interests include artificial intelligence,swarm intelligence and evolutionary computing,and big data intelligence.
  • Supported by:
    National Natural Science Foundation of China(61772200,61772201,61602175),Shanghai Pujiang Talent Program(17PJ1401900) and Shanghai Economic and Information Commission “Special Fund for Information Development”(201602008).

Abstract: In the era of intelligence,continuous autonomous learning and optimization need to be carried out on the big data platform,and the first step of continuous autonomous learning is data enhancement.This paper proposes a broad learning method based on cascaded enhancement nodes,which provides a new data enhancement method for continuous autonomous learning on big data platform,and makes it possible for subsequent evolutionary optimization on the basis of learning architecture.Classical broad learning is a typical feedforward neural network,which is not suitable for modeling dynamic time series.In this paper,the feedback structure is introduced into the traditional broad learning system,which makes the enhancement nodes have memory and retains part of the historical information.In feature extraction,phase space reconstruction is used to extract more essential features of the data.At the same time,a weight factor is introduced to assign different weights to each sample according to its contribution to model during training,so as to eliminate the interference of noise and outliers to the learning process and improve the robustness of the algorithm.Experimental results show that the proposed algorithm is effective.

Key words: Broad learning, Data enhancement, Time series prediction, Weight factor

CLC Number: 

  • TP183
[1] CAO B,WANG N,LI J,et al.Data Augmentation-Based Joint Learning for Heterogeneous Face Recognition[J].IEEE Tran-sactions on Neural Networks and Learning Systems,2018,30(6):1731-1743.
[2] LEMLEY J,BAZRAFKAN S,CORCORAN P.Smart Augmentation Learning an Optimal Data Augmentation Strategy[J].IEEE Access,2017,5:5858-5869.
[3] BOX G E P,PIERCE D A.Distribution of Residual Autocorrela-tions in Autoregressive-Integrated Moving Average Time Series Models[J].Journal of the American Statistical Association,1970,65(332):1509-1526.
[4] YU G,HU J,ZHANG C,et al.Short-Term Traffic Flow Forecasting Based on Markov Chain Model[C]//IEEE IV2003 Intelligent Vehicles Symposium.IEEE,2003:208-212.
[5] WANG J,DENG W,GUO Y.New Bayesian Combination Me-thod for Short-Term Traffic Flow Forecasting[J].Transportation Research Part C:Emerging Technologies,2014,43:79-94.
[6] FENG L,ZHAO C,CHEN C L P,et al.BNGBS:An Efficient Network Boosting System With Triple Incremental Learning Capabilities for More Nodes,Samples,and Classes[J].Neurocomputing,2020,412:486-501.
[7] HOU J X,LI Q,ZHU Y J,et al.Real-Time Forecasting System of PM2.5 Concentration Based on Spark Framework and Random Forest Model[J/OL].Science of Surveying and Mapping,2007.http://en.cnki.com.cn/Article_en/CJFDTotal-CHKD201701001.htm.
[8] HOCHREITER S,SCHMIDHUBER J.Long Short-Term Me-mory[J].Neural Computation,1997,9(8):1735-1780.
[9] XIE K,RONG Y T,HU F P,et al.Random Forest Algorithm Based on Data Integration[J].Computer Engineering,2020,46(12):290-298.
[10] CHUNG J,GULCEHRE C,CHO K H,et al.Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling[J].arXiv:1412.3555,2014.
[11] CHEN T T,LEE S J.A Weighted LS-SVM Based Learning System for Time Series Forecasting[J].Information Sciences,2015,299:99-116.
[12] SONG X L,LIU Y Z,CHEN S F.Seasonal Time Series Forecasting Based on Seasonality Method Selection[J].Computer Engineering,2011,37(21):131-132,135.
[13] HUANG S,WANG D,WU X,et al.Dsanet:Dual Self-attention Network for Multivariate Time Series Forecasting[C]//Proceedings of the 28th ACM International Conference on Information and Knowledge Management.2019:2129-2132.
[14] CHEN C L P.A Rapid Supervised Learning Neural Network for Function Interpolation and Approximation[J].IEEE Transactions on Neural Networks,1996,7(5):1220-1230.
[15] CHEN C L P,LECLAIR S R,PAO Y H.An Incremental Adaptive Implementation of Functional-Link Processing for Function Approximation,Time-Series Prediction,and System Identification[J].Neurocomputing,1998,18(1/2/3):11-31.
[16] CHEN C L P,WAN J Z.A Rapid Learning and Dynamic Stepwise Updating Algorithm for Flat Neural Networks and the Application to Time-Series Prediction[J].IEEE Transactions on Systems,Man,and Cybernetics,Part B (Cybernetics),1999,29(1):62-72.
[17] CHEN C L P,LIU Z.Broad Learning System:An Effective and Efficient Incremental Learning System without the Need for Deep Architecture[J].IEEE Transactions on Neural Networks and Learning Systems,2017,29(1):10-24.
[18] HAN M,ZHANG R,QIU T,et al.Multivariate Chaotic Time Series Prediction Based on Improved Grey Relational Analysis[J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,49(10):2144-2154.
[19] WANG M D,XU X Y,YAN G W,et al.Ensemble Weighted Broad Learning System with AdaBoost for Imbalanced Classification[J].Computer Engineering,2020,48(4):99-105,112.
[20] XU M,HAN M,CHEN C L P,et al.Recurrent Broad Learning Systems for Time Series Prediction[J].IEEE Transactions on Cybernetics,2018,50(4):1405-1417.
[1] LIU Bao-bao, YANG Jing-jing, TAO Lu, WANG He-ying. Study on Prediction of Educational Statistical Data Based on DE-LSTM Model [J]. Computer Science, 2022, 49(6A): 261-266.
[2] WANG Xiao-di, LIU Xin, YU Xiao. Adaptive Frequency Domain Model for Multivariate Time Series Forecasting [J]. Computer Science, 2021, 48(11A): 204-210.
[3] YANG Hai-min, PAN Zhi-song, BAI Wei. Review of Time Series Prediction Methods [J]. Computer Science, 2019, 46(1): 21-28.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!