一种基于近邻边界的粒度支持向量机学习策略

doi:10.11896/j.issn.1002-137X.2016.03.050

摘要/Abstract

摘要： 针对粒度支持向量机进行粒划分后提取代表点时丢失部分重要分类信息从而影响分类准确率的情况,提出了一种基于近邻边界的粒度支持向量机(Neighboring-boundary Granular Support Vector Machine,NGSVM)的学习策略。首先采用kmeans方法进行粒划分,对不同的粒依据不同的规则提取粒内代表点,并按照要求分别将代表点放入精简集或修正集中,再用这两个集合中的数据对支持向量机进行训练；形成分类器后,根据核空间距离提取靠近分类面的近邻边界数据以对分类面进行修正。仿真实验结果表明,通过提取靠近分类面的近邻边界数据进行重新训练,能够修正分类面,进一步提高粒度支持向量机的分类准确率。

关键词: 近邻边界,粒度支持向量机,粒度,精简集,修正集

Abstract: Granular support vector machine will lead to loss of partial classification information and accuracy degradation while dividing granules and extracting representative points.To solve this problem,a learning strategy based on neighboring-boundary granular support vector machine (NGSVM) was proposed.Samples were divided into granules with kmeans method firstly,different granules were dealt with different rules to extract representative points,and then these representative points were put into fixed set or reduced set as requested,by which support vector machine (SVM) was trained.After completion of classifier,classification plane would be rectified by extracting neighboring-boundary samples according to the kernel distance.The simulation results show that NGSVM gains a higher classification accuracy by extracting neighboring-boundary samples near classification plane and fixing classification plane.

Key words: Neighboring-boundary,Granular support vector machine,Granules,Reduced set,Fixed set

张春艳,倪世宏,查翔. 一种基于近邻边界的粒度支持向量机学习策略[J]. 计算机科学, 2016, 43(3): 271-274. https://doi.org/10.11896/j.issn.1002-137X.2016.03.050

ZHANG Chun-yan, NI Shi-hong and ZHA Xiang. Learning Strategy Based on Neighboring-boundary Granular Support Vector Machine[J]. Computer Science, 2016, 43(3): 271-274. https://doi.org/10.11896/j.issn.1002-137X.2016.03.050

参考文献

[1] Ding Shi-fei,Qi Bing-juan,Tan Hong-yan.An overview on theory and algorithm of support vector machines[J].Journal of University of Electronic Science and Technology of China,2011,0(1):2-10(in Chinese) 丁世飞,齐丙娟,谭红艳.支持向量机理论与算法研究综述[J].电子科技大学学报,2011,0(1):2-10
[2] de Almeida M B,de Padua Braga A, Braga J P.SVM-KM:speed SVMs learning with a priori cluster selection and k-means[C]∥ Proceedings of the Sixth Brazilian Symposium on Neural Networks.Riode Janeiro,R J,Brazil,2000:162-167
[3] Horng S-J,Su Ming-yang,Chen Y-H,et al.A novel intrusion detection system based on hierarchical clustering and support vector machines [J].Expert Systems with Applications,2011,38(1):306-313
[4] Yao Yi-yu.Perspectives of granular computing[C]∥ Proc of the IEEE International Conference on Granular Computing.Beijing,China,2005:85-90
[5] Tang Yu-chun,Jin Bo,Zhang Yan-qing.Granular support vector machines for medical binary classification problems[C]∥ Proc of the IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology.La Jolla,USA,2004:73-78
[6] Zhang Yu,Wang Wen-jian,Guo Hu-sheng.An SVM accelerated training approach based on granular distribution[J].Journal of Nanjing University(Natural Sciences),2013,49(5):644-649(in Chinese) 张宇,王文剑,郭虎升.基于粒分布的支持向量机加速训练方法[J].南京大学学报(自然科学版),2013,9(5):644-649
[7] Wang Wen-jian,Guo Hu-sheng.Granular support vector ma-chine learning model[J].Journal of Shanxi University(Natural Science Edition),2009,2(4):535-540(in Chinese) 王文剑,郭虎升.粒度支持向量机学习模型[J].山西大学学报(自然科学版),2009,2(4):535-540
[8] Zhang Wen-hao,Wang Wen-jian.A Kernel Granular SupportVector Machine Based on Association Rules[J].Journal of Guangxi Normal University(Natural Sciences),2009,7(3):89-92(in Chinese) 张文浩,王文剑.一种基于关联规则的核粒度支持向量机[J].广西师范大学学报(自然科学版),2009,7(3):89-92
[9] Ertekin S,Huang Jian,Bottou L,et al.Learning on the border:active learning in imbalanced data classification [C]∥Procee-dings of the Sixteenth Conference ACM on Information and Knowledge Management.Lisbon,Portugal,2007:127-136
[10] Hu Zheng-ping,Gao Wen-tao.Training sample selection algo-rithm for SVM based on modified weighted condensed nearest neighbor and close-to-boundary criterion[J].Journal of Yanshan University,2010,4(5):421-426(in Chinese) 胡正平,高文涛.基于改进加权压缩近邻与最近边界规则SVM训练样本约减选择算法[J].燕山大学学报,2010,34(5):421-426
[11] de Sá J P M.Pattern recognition concepts,methods and applications [M].Beijing:Tsinghua University Press,2002:21-22
[12] Du Shu-xin,Wu Tie-jun.Support vector machines for pattern recognition[J].Journal of Zhejiang University (Technology Edition),2003,37(5):521-528(in Chinese) 杜树新,吴铁军.模式识别中的支持向量机方法[J].浙江大学学报(工学版),2003,7(5):521-528

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed