Computer Science ›› 2014, Vol. 41 ›› Issue (6): 166-170.doi: 10.11896/j.issn.1002-137X.2014.06.032

Previous Articles     Next Articles

Incremental Learning with Support Vector Regression

ZHANG Yi-fan,FENG Ai-min and ZHANG Zheng-lin   

  • Online:2018-11-14 Published:2018-11-14

Abstract: In view of costly time-space complexity for support vector regression in dealing with large scale data,this paper presented a novel algorithm named the L Incremental υ Support Vector Regression (LISVR) by means of incremental learning.LISVR eliminates non-support vectors each iteration and then takes the support vectors as the training samples with the weight factor.It reduces time-space complexity and enhances the regression results simultaneously.Theoretically,this paper proved the convergence of the global optimal solution.The experiments on the artificial data sets,UCI data set and airport noises show the effectiveness of the LISVR.

Key words: Support vector regression,Support vectors,Incremental learning,Airport noise

[1] Syed N,Liu H,Sung K.Incremental learning with support vector machines[C]∥Proceedingsof the Workshop on Support Vector Machines atthe International Joint Conference on Articial Intelligence(IJCAI-99).Stockholm,Sweden,1999
[2] Qing L,Ling W,Zheng Z D.Decremental learning based on sample weight Support Vector Regression[M]∥Control and Decision.2010:1322-1325
[3] Platt J C.Fast Training of Support Vector Machines using Sequential Minimal Optimization [M]∥Advances in Kernel Methods.MIT Press Cambridge,MA,USA,1999:185-208
[4] Cauwenberghs G,Poggio T.Incremental and decremental support vector machine learning[M]∥Advances in Neural Information Processing Systems.2001:409-415
[5] Schlkopf B,Smola A J,Williamson R C,et al.New support vector algorithms[J].Neural computation,2000,12(5):1207-1245
[6] Ruping S.Incremental learning with support vector machines[C]∥ Proceedings IEEE International Conference on Data Mi-ning,2001(ICDM 2001).IEEE,2001:641-642
[7] Li C,Liu K,Wang H.The incremental learning algorithm with support vector machine based on hyperplane-distance[J].Applied Intelligence,2011,34(1):19-27
[8] Ma J,Theiler J,Perkins S.Accurate on-line support vector regression[J].Neural Computation,2003,15(11):2683-2703
[9] Smola A J,Schlkopf B.A tutorial on support vector regression[J].Statistics and computing,2004,14(3):199-222
[10] Wang W.An incremental learning strategy for support vector regression[J].Neural processing letters,2005,21(3):175-188
[11] Yi Y,Wu J,Xu W.Incremental SVM based on reserved set for network intrusion detection[J].Expert Systems with Applications,2011,38(6):7698-7707
[12] Hai Y,He W,Fan L.An incremental learning algorithm for SVM based on voting principle[C]∥20106th International Conference on Advanced Information Management and Service (IMS).IEEE,2010:420-423
[13] 王媛.支持向量机增量学习算法及其在入侵检测中的应用研究[D].长春:吉林大学,2008
[14] Wang J G,Cheng L W,Zhang W X,et al.A modified incremental support vector machine for regression[J].Applied Mechanics and Materials,2012,135:63-69
[15] Ralaivola L,d’Alché-Buc F.Incremental support vector machine learning:A local approach[M]∥Artificial Neural Networks—ICANN 2001.Springer Berlin Heidelberg,2001:322-330
[16] Vallada E,Ruiz R.Genetic algorithms with path relinking forthe minimum tardiness permutation flowshop problem[J].Omega,2010,38(1):57-67
[17] 萧嵘,王继成,孙正兴.一种SVM增量学习算法 α-ISVM [J].软件学报,2001,12(12):1818-1824
[18] 宋辰瑶,徐国华.前飞状态下直升机旋翼旋转噪声预测[J].声学技术,2009,8(2)
[19] 刘占良,赫旭.机场航空噪声监测与评价方法[J].中国海洋大学报,2006,36(4):660-664
[20] 武汉英.飞机噪声预测模型及其应用[D].天津:中国民航大学,2008
[21] Graf H P,Cosatto E,Bottou L,et al.Parallel support vector machines:The cascade svm[J].Advances in neural information processing systems,2004,17:521-528
[22] Mitra P,Murthy C A,Pal S K.Data condensation in large databases by incremental learning with support vector machines[C]∥Proceedings 15th International Conference on Pattern Recognition,2000.IEEE,2000,2:708-711
[23] Laskov P,Gehl C,Krüger S,et al.Incremental support vector learning:Analysis,implementation and applications[J].The Journal of Machine Learning Research,2006,7:1909-1936
[24] Diehl C P,Cauwenberghs G.SVM incremental learning,adaptation and optimization[C]∥Proceedings of the International Joint Conference on Neural Networks,2003.IEEE,2003,4:2685-2690

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!