基于类内散度的粗糙one-class支持向量机

doi:10.11896/j.issn.1002-137X.2016.12.024

摘要/Abstract

摘要： 粗糙one-class支持向量机(ROC-SVM)在粗糙集理论基础上通过构建粗糙上超平面和下超平面来处理过拟合问题,但是在寻找最优分类超平面的过程中,忽略了训练样本类内结构这一非常重要的先验知识。因此,提出了一种基于类内散度的粗糙one-class支持向量机(WSROC-SVM),该方法通过最小化训练样本类内散度来优化训练样本类内结构,一方面使训练样本在高维特征空间中与坐标原点的间隔尽可能大,另一方面使得训练样本在粗糙上超平面尽可能紧密。在合成数据集和UCI数据集上的实验结果表明,较原始算法,该方法有着更高的识别率和更好的泛化性能,在解决实际分类问题上更具优越性。

关键词: 粗糙集,一类支持向量机,类内散度,过拟合

Abstract: Classical rough one-class support vector machine(ROC-SVM) constructs rough upper margin and rough lo-wer margin to deal with the over-fitting problem on rough set theory.However,in the process of searching for the optimal classification hyper-plane,ROC-SVM ignores the inner-class structure of the training data which is a very important prior knowledge.Thus,a rough set one-class support vector machine based on within-class scatter(WSROC-SVM) was proposed.This algorithm optimizes the inner-class structure of the training data by minimizing the within-class scatter of the training data.It not only precipitates margin between the origin and the training data in a higher dimensional space as large as possible,but also makes the training data close around the rough upper margin as tight as possible.Experimental results carried out on one synthetic dataset and the UCI dataset indicate that the proposed method improves the accuracy as well as the generalization of the result.And it is more advantageous in solving practical classification problems.

Key words: Rough set,One-class SVM,Within-class scatter,Over-fitting

张彬,朱嘉钢. 基于类内散度的粗糙one-class支持向量机[J]. 计算机科学, 2016, 43(12): 135-138. https://doi.org/10.11896/j.issn.1002-137X.2016.12.024

ZHANG Bin and ZHU Jia-gang. Rough Set One-class Support Vector Machine Based on Within-class Scatter[J]. Computer Science, 2016, 43(12): 135-138. https://doi.org/10.11896/j.issn.1002-137X.2016.12.024

参考文献

[1] Tax D M J,Duin R P W.Support Vector Data Description [J].Machine Learning,2004,54(1):45-66
[2] Campbell C,Bennett P.A Linear Programming Approach toNovelty Detection [M].Advances in Neural Information Processing Systems.Cambridge:MIT Press,2001
[3] Schlkopf B,Platt J C,Shawe-Taylor J,et al.Estimating thesupport of a high-dimensional distribution[J].Neural Computation,2001,13(7):1443-1471
[4] Lin C F,Wang S D.Fuzzy Support Vector Machine [J].IEEE Transactions on Neural Networks,2002,13(2):464-471
[5] Xu Yi-tian,Liu Chun-mei.A rough margin-based one class support vector machine[J].Neural Comput & Applic,2013(22):1077-1084
[6] Bishop C M.Pattern Recognition and Machine Learning [M].Cambridge:Springer,2007:291-320
[7] Jun G,Chung F,Wang S.Matrix pattern based minimum within-class scatter support vector machines[J].Applied Soft Computing,2011,11(8):5602-5610
[8] Zhang J,Wang K,Zhu W,et al.Least Squares Fuzzy One-class Support Vector Machine for Imbalanced Data[J].International Journal of Signal Processing,Image Processing and Pattern Re-cognition,2015,8(8):299-308
[9] Jeong Y S,Kang I H,Jeong M K,et al.A New Feature Selection Method for One-Class Classification Problems [J].IEEE Tran-sactions on Systems,Man,and Cybernetics－part c:Applications and Reviews,2012,2(6):1500-1509
[10] Zhu W,Zhong P.A new one-class SVM based on hidden information[J].Knowledge-Based Systems,2014,60(2):35-43
[11] Asharaf S,Shevade S K,Narasimha murty M.Rough support vector clustering[J].Pattern Recognition,2005,38(10):1779-1783
[12] Xiao Y,Wang H,Xu W.Parameter Selection of Gaussian Kernel for One-Class SVM[J].IEEE transactions on cybernetics,2015,45(5):927-939
[13] An W,Liang M.Fuzzy support vector machine based on within-class scatter for classification problems with outliers or noises[J].Neurocomputing,2013,110(6):101-110
[14] Wang L,Jia H D,Li J.Training Robust Support Vector Machine with Smooth Ramp Loss in the Primal [J].Neurocomputing,2008,71:3020-3025
[15] Junejo I N,Bhutta A A,Foroosh H.Single-class SVM for dynamic scene modeling [J].SIViP,2013,7(1):45-52
[16] Mygdalis V,Iosifidis A,Tefas A,et al.Exploiting subclass information in one-class support vector machine for video summarization[C]∥2015 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP).IEEE,2015:2259-2263
[17] Wang Lei,Yang Yi-fan,Zhou Qi-hai.Rough Set based One-class Support Vector Machine[J].Computer Science,2009,36(9):242-245(in Chinese) 王磊,杨一帆,周启海.粗糙one-class支持向量机[J].计算机科学,2009,36(9):242-245
[18] http://archive.ics.uci.edu/ml/datasets.html

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed