计算机科学 ›› 2016, Vol. 43 ›› Issue (2): 230-234.doi: 10.11896/j.issn.1002-137X.2016.02.048

• 人工智能 • 上一篇    下一篇

基于双支持向量回归机的增量学习算法

郝运河,张浩峰   

  1. 南京理工大学计算机科学与工程学院 南京210094,南京理工大学计算机科学与工程学院 南京210094
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国家自然科学基金(61101197),水下机器人技术国防科技重点实验室基金(9140C270205120C2701)资助

Incremental Learning Algorithm Based on Twin Support Vector Regression

HAO Yun-he and ZHANG Hao-feng   

  • Online:2018-12-01 Published:2018-12-01

摘要: 提出了一种基于双支持向量回归机的增量学习算法。将获取到的新样本加入训练数据集后,该算法无需在整个新的数据集上重新训练双支持向量回归机,而是充分利用增量前的计算信息,从而大大减少了模型更新中逆矩阵的计算量,提高了算法的执行效率。在人工数据集、时间序列预测和UCI数据集上的数值实验表明,该算法快速有效。

关键词: 双支持向量回归机,增量学习,逆矩阵,时间序列

Abstract: This paper proposed an incremental learning algorithm based on twin support vector regression.When a new sample is added to the training set,our algorithm makes full use of old computing information instead of training all the new training set,so it greatly simplifies the calculation of inverse matrix and improves the execution efficiency.Experimental results on artificial datasets,time series and UCI datasets show that our algorithm has remarkable improvement of generalization performance with short training time.

Key words: Twin support vector regression,Incremental learning,Inverse matrix,Time series

[1] Vapnik V.The nature of statistical learning theory[M].Sprin-ger,2000
[2] Burges C J C.A tutorial on support vector machines for pattern recognition[J].Data Mining and Knowledge Discovery,1998,2(2):121-167
[3] Cristianini N,Shawe-Taylor J.Kernel methods for pattern ana-lysis[M].Cambridge University Press,2004
[4] Suykens J A K,Vandewalle J.Least squares support vector machine classifiers[J].Neural processing letters,1999,9(3):293-300
[5] Zhou Jin-zhu,Huang Jin.Multiple kernel liner programming sup-port vector regression incorporating prior knowledge[J].Acta Automatica Sinica,2011,37(3):360-370(in Chinese) 周金柱,黄进.集成先验知识的多核线性规划支持向量回归[J].自动化学报,2011,37(3):360-370
[6] Khemchandani R,Chandra S.Twin support vector machines for pattern classification[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(5):905-910
[7] Shao Y H,Deng N Y,Yang Z M,et al.Probabilistic outputs for twin support vector machines[J].Knowledge-Based Systems,2012,33:145-151
[8] Shao Y H,Deng N Y,Yang Z M.Least squares recursive projection twin support vector machine for classification[J].Pattern Recognition,2012,45(6):2299-2307
[9] Peng X.TSVR:an efficient twin support vector machine for regression[J].Neural Networks,2010,23(3):365-372
[10] Shao Y H,Zhang C H,Yang Z M,et al.An ε-twin support vector machine for regression[J].Neural Computing and Applications,2013,23(1):175-185
[11] Peng X.Primal twin support vector regression and its sparse approximation[J].Neurocomputing,2010,73(16):2846-2858
[12] Lu G F,Zou J,Wang Y.Incremental learning of complete linear discriminant analysis for face recognition[J].Knowledge-Based Systems,2012,31:19-27
[13] Deguchi T,Ishii N.On Memory Capacity in Incremental Lear-ning with Appropriate Refractoriness and Weight Increment[C]∥2011 First ACIS/JNU International Conference on Computers,Networks,Systems and Industrial Engineering (CNSI).IEEE,2011:427-430
[14] Ross D A,Lim J,Lin R S,et al.Incremental learning for robust visual tracking[J].International Journal of Computer Vision,2008,77(1-3):125-141
[15] Khreich W,Granger E,Miri A,et al.A survey of techniques for incremental learning of HMM parameters[J].Information Scie-nces,2012,197:105-130
[16] Yuan Ya-xiang,Sun Wen-yu.Optimization theory and methods[M].Beijing:Science Press,1997(in Chinese) 袁亚湘,孙文瑜.最优化理论与方法[M].北京:科学出版社,1997
[17] Zhang Xiao-yun,Liu Yun-cai.Performace analysis of support vector machines with Gauss kernel[J].Computer Engineering,2003,29(8):22-25(in Chinese) 张小云,刘允才.高斯核支撑向量机的性能分析[J].计算机工程,2003,9(8):22-25

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!