计算机科学 ›› 2013, Vol. 40 ›› Issue (5): 279-282.

• 综述 • 上一篇    下一篇

一种带修剪的增量极速学习模糊神经网络

胡蓉,徐蔚鸿   

  1. 南京理工大学计算机科学与技术学院 南京210000;南京理工大学计算机科学与技术学院 南京210000
  • 出版日期:2018-11-16 发布日期:2018-11-16
  • 基金资助:
    本文受国家自然科学基金(61163040),湖南省教育厅科研项目(11C0009)资助

Pruned Incremental Extreme Leaning Machine Fuzzy Neural Network

HU Rong and XU Wei-hong   

  • Online:2018-11-16 Published:2018-11-16

摘要: 由Huang提出的extreme learning machine(ELM)批量学习算法在获得与其他算法相当的性能的同时显示出了极快的学习速度。为了实现在线增量学习,扩展了ELM方法,提出了一种带修剪的极速学习模糊神经网络。首先随机产生模糊神经网络前件参数和规则数量,然后使用SVD将规则按照重要性能排序,再使用留一法leave-one-out(LOO)选出最佳的模糊规则数,最后分析计算模糊规则的后件参数。在学习过程中无须保存过去的数据,真正实现了增量学习。当新的数据到来时,无须重新训练网络。通过仿真实验对该方法与其他算法进行了验证和比较,结果表明,在获得与其他算法类似的性能的情况下,该算法能够获得更加简洁的结构。

关键词: 极速学习机(ELM),增量学习,模糊神经网络,径向基函数

Abstract: ELM for batch learning developed by Huang et al has been shown to be extremely fast with generalization performance better than other batch training methods.In order to lean online,a pruned incremental extreme leaning algorithm was developed for fuzzy neural network.Based on the previously proposed ELM method,we proposed a pruned incremental extreme leaning algorithm.First a set of simple antecedents and random values for the parameters of input membership functions were randomly generated.Then SVD was used to rank the fuzzy basis functions.Then the best number of fuzzy rules was selected by performing a fast computation of the leave-one-out validation error.Finally,the consequents parameters were determined analytically.During the procedure of learning,it is not need to memory the last date.It is a real incremental leaning method.When a new data arrives,it is not need to retrain the network.A comparison was performed against well known neuro-fuzzy methods.It is shown that the method proposed is robust and competitive in terms of accuracy and speed.

Key words: Extreme leaning machine(ELM),Incremental earning algorithm,Fuzzy neural netwok(FNN),Radial basis function

[1] Li H X,Liu Z.A probabilistic neural-fuzzy learning system for stochastic modeling [J].IEEE Transaction on Fuzzy System,2008,16(4):898-908
[2] Zhao Y,Gao H J,Mou S S.Asymptotic stability analysis of neural networks with successive time delay components[J].Neurocomput,2007,71(13-15):2848-2856
[3] Huang H,Ho D W C,Cao J D.Analysis of global exponential stability and periodic solutions of neural networks with time-varying delays[J].Neural Netw,2005,8(2):161-170
[4] Kasabov N K,Song Q.DENFIS:Dynamic Evolving NeuralFuzzy Inference System and Its Application for Time-Series Prediction[J].IEEE Trans.Fuzzy Syst.,2002,10(2):144-154
[5] Angelov P P,Filev D P.An approach to online identification of Takagi-Sugeno fuzzy models[J].IEEE Trans.Syst.Man Cybern.B,2004,4(1):484-498
[6] Angelov P,Filev D.Simpl_eTS:A simplified method for learning evolving Takagi-Sugeno fuzzy models[C]∥Proc.14th IEEE Int.Conf.Fuzzy Syst.2005:1068-1073
[7] Rong H-J,Sundararajan N,Huang G-B,et al.Sequential Adaptive Fuzzy Inference System(SAFIS) for nonlinear system identification and prediction[J].Fuzzy Sets Syst.,2006,7(9):1260-1275
[8] Pouzols F M,Lendasse A.Evolving fuzzy optimally pruned extreme learning machinefor regression problems[J].Evolving Systems,2010,1(1):43-58
[9] Huang G B,Zhu Q Y,Siew C K.Extreme learning machine:Theory and applications[J].Neurocomputing,2006,70(1-3):489-501
[10] Miche Y,Sorjamaa A,Bas P,et al.OP-ELM:Optimally pruned extreme learning machine[J].IEEE Trans.Neural Network,2010,1(1):158-162
[11] Miche Y,Sorjamaa A,Lendasse A.OP-ELM:Theory,Experi- ments and a Toolbox[C]∥Proc.Int.Conf.Artif.Neural Netw.,ser.Lect.Notes Comput.Sci.2008,5163:145-154
[12] Sorjamaa A,Miche Y,Weiss R,et al.Long-Term Prediction of Time Series using NNE-based Projection and OP-ELM[C]∥Proc.Inter.Jt.Conf.Neural Netw.,Hong Kong,China,June 2008:2675-2681
[13] Huang G-B,Chen L,Siew C-K.Universal approximaion usingincremental constructuve feedforward networks with random hidden nodes[J].IEEE Trans.Neural Netw.,2006,7(4):879-892
[14] Liang N-Y,Huang G-B,Huang G-B,et al.A fast and accurate online sequential learning algorithm for feedforward networks[J].IEEE Trans.Neural Netw.,2006,7(6):1411-1423
[15] 许哲万,李昌皎,王爱侠,等.一种基于改进T-S模糊推理的模糊神经网络学习算法[J].计算机科学,2011,8(11):196-199,9
[16] 朱彦卿,何怡刚.一种基于模糊神经网络的模拟电路故障诊断方法 [J].计算机科学,2010,7(12):280-28

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!