孪生支持向量机综述

doi:10.11896／j.issn.1002-137X.2018.11.003

Abstract

Abstract: Twin support vector machine (TWSVM) is a useful extension of the traditional support vector machine(SVM).For the binary classification problem,the basic idea of TWSVM is to seek two nonparallel hyperplanes such that each hyperplane is closer to one and is at least one distance from the other.As an emerging machine learning me-thod,TWSVM has attracted the attention of scholars and become a hotspot in machine learnig.This paper reviewed the development of TWSVM.At first,this paper analyzed the basic concept of the twin support vector machine,summarized the models and research process of novel algorithms of TWSVM in the last several years.Then,it analyzed the advantages and disadvantages of them and performed experiments on them.At last,it prospected the research work of TWSVM.

Key words: Least squares twin support vector machine, Multi-class classification, Optimization, Support vector machine, Twin support vector machine

CLC Number:

TP181

AN Yue-xuan, DING Shi-fei, HU Ji-pu. Twin Support Vector Machine:A Review[J].Computer Science, 2018, 45(11): 29-36.

0
/ / Recommend

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

URL: https://www.jsjkx.com/EN/10.11896／j.issn.1002-137X.2018.11.003

https://www.jsjkx.com/EN/Y2018/V45/I11/29

References

[1]CORTES C,VAPNIK V.Support-vector networks[J].Machine Learning,1995,20(3):273-297.
[2]VAPNIK V N.统计学习理论的本质[M].张学工,译.北京:清华大学出版社,2000.
[3]DING S F,QI B J,TAN H Y.An overview on theory and algorithm of support vector machines[J].Journal of University of Electronic Science and Technology of China,2011,40(1):2-10.
[4]MANGASARIAN O L,WILD E W.Multisurface proximal support vector machine classification via generalized eigenvalues[J].IEEE Trans. Pattern Anal. Mach. Intell.,2006,28(1):69-74.
[5]JAYADEVA,KHEMCHANDNI R,SURESH C.Twin support vector machines for pattern classification[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(5):905-910.
[6]DING S F,HUA X P,YU J Z.An overview on nonparallel hyperplane support vector machine algorithms[J].Neural Computing and Applications,2014,25(5):975-982.
[7]TOMAR D,AGARWAL S.Twin Support Vector Machine:A review from 2007 to 2014[J].Egyptian Informatics Journal,2015,16(1):55-69.
[8]TIAN Y,QI Z.Review on:Twin Support Vector Machines[J].Annals of Data Science,2014,1(2):253-277.
[9]KUMAR M A,GOPAL M.Least squares twin support vector machines for pattern classification[J].Expert Systems with Applications,2009,36(4):7535-7543.
[10]FUNG G,MANGASARIAN O L.Proximal support vector machine classifiers[C]∥Proceedings of Seventh International Conference on Knowledge and Data Discovery.2001:77-86.
[11]ZHANG Z,ZHEN L,DENG N,et al.Sparse least square twin support vector machine with adaptive norm[J].Applied Intelligence,2014,41(4):1097-1107.
[12]TANVEER M,KHAN M A,HO S S.Robust energy-based least squares twin support vector machines[J].Applied Intelligence,2016,45(1):174-186.
[13]XU Y,PAN X,ZHOU Z,et al.Structural least square twin support vector machine for classification[J].Applied Intelligence,2015,42(3):527-536.
[14]YE Q,ZHAO C,GAO S,et al.Weighted twin support vector machines with local information and its application[J].Neural Networks the Official Journal of the International Neural Network Society,2012,35(11):31-39.
[15]REZVANI-KHORASHADIZADEH R,REZA M.WS-TWS- VM:Weighted Structural Twin Support Vector Machine by local and global information[C]∥International Conference on Computer and Knowledge Engineering.2015:170-175.
[16]XU Y.K-nearest neighbor-based weighted multi-class twin support vector machine[M].Elsevier Science Publishers B.V.2016.
[17]CHEN X,YANG J,YE Q,et al.Recursive projection twin support vector machine via within-class variance minimization[J].Pattern Recognition,2011,44(10):2643-2655.
[18]SHAO Y H,WANG Z,CHEN W J,et al.A regularization for the projection twin support vector machine[J].Knowledge-Based Systems,2013,37(2):203-210.
[19]DING S F,HUA X P.Recursive least squares projection twin support vector machines for nonlinear classification[J].Neurocomputing,2014,130(3):3-9.
[20]XIE X.Improvement on projection twin support vector machine[J].Neural Computing & Applications,2017(5):1-17.
[21]YAN A R,YE B Q,ZHANG C L,et al.A Feature Selection Method for Projection Twin Support Vector Machine[J].Neural Processing Letters,2017(3):1-18.
[22]GU Z,ZHANG Z,SUN J.Robust Image Recognition by L1- norm Twin-Projection Support Vector Machine[J].Neurocomputing,2017,223:1-11.
[23]DING S F,ZHANG J,ZHANG X K,et al.Survey on Multi class Twin Support Vector Machines[J].Journal of Software,2018,29(1):89-108.(in Chinese)
丁世飞,张健,张谢锴,等.多分类孪生支持向量机研究进展[J].软件学报,2018,29(1):89-108.
[24]TOMAR D,AGARWAL S.An effective Weighted Multi class Least Squares Twin Support Vector Machine for Imbalanced data classification[J].International Journal of Computational Intelligence Systems,2015,8(4):761-778.
[25]CHEN S G,WU X J.Multiple birth least squares support vector machine for multi-class classification[J].International Journal of Machine Learning & Cybernetics,2017,8(6):1731-1742.
[26]KHEMCHANDANI R,PAL A.Tree based multi-category Laplacian TWSVM for content based image retrieval[J].International Journal of Machine Learning & Cybernetics,2017,8(4):1197-1210.
[27]DING S F,ZHANG X K,AN Y X,et al.Weighted Linear Loss Multiple Birth Support Vector Machine based on Information Granulation for Multi-class Classification[J].Pattern Recognition,2017,67:32-46.
[28]GU H B,NIU B,GAO Z X.A directed acyclic graph algorithm for multi-class classification based on twin support vector machine[J].Journal of Information & Computational Science,2014,11(18):6529-6536.
[29]CHEN J,JI G R.Multi class LSTSVM classifier based on optimal directed acyclic graph[C]∥International Conference on Computer and Automation Engineering.IEEE,2010:100-104.
[30]ZHANG X,DING S,SUN T.Multi-class LSTMSVM based on optimal directed acyclic graph and shuffled frog leaping algorithm[J].International Journal of Machine Learning & Cybernetics,2016,7(2):241-251.
[31]XU Y T,GUO R,WANG L S.A twin multi class classification support vector machine[J].Cognitive Computation,2013,5(4):580-588.
[32]PARASTALOOI N,AMIRI A,ALIHEYDARI P.Modified Twin Support Vector Regression[J].Neurocomputing,2016,211(C):84-97.
[33]SARTAKHTI J S,AFRABANDPEY H,SARAEE M.Simulated annealing least squares twin support vector machine (SA-LSTSVM) for pattern classification[J].Soft Computing,2017,21(15):4361-4373.
[34]DING S F,ZHANG X K,YU J Z.Twin support vector machines based on fruit fly optimization algorithm[J].International Journal of Machine Learning and Cybernetics,2016,7(2):1-11.
[35]ZHANG X K,DING S F.Mahalanobis Distance-based Twin Multi-class Classification Support Vector Machine[J].Compu-ter Science,2016,43(3):49-53.(in Chinese)
张谢锴,丁世飞.基于马氏距离的孪生多分类支持向量机[J].计算机科学,2016,43(3):49-53.
[36]DING S F,AN Y X,ZHANG X K,et al.Wavelet twin support vector machines based on glowworm swarm optimization[J].Neurocomputing,2017,225(15):157-163.
[37]XIE X,SUN S.Multi-view twin support vector machines[J].Intelligent Data Analysis,2015,19(4):701-712.
[38]CHEN W J,SHAO Y H,LI C N,et al.MLTSVM:A novel twin support vector machine to multi-label learning[J].Pattern Re-cognition,2016,52:61-74.
[39]CHEN S,WU X,ZHANG R.A Novel Twin Support Vector Machine for Binary Classification Problems[J].Neural Proces-sing Letters,2016,44(3):1-17.
[40]HAO P Y.Pair-v-SVR:A Novel and Efficient Pairing nu-Support Vector Regression Algorithm[J].IEEE Transactions on Neural Networks & Learning Systems,2017,28(11):2503-2510.
[41]PENG X J,SHEN J D.A twin hyperspheres support vector machine with automatic variable weights for data classification[J].Information Science,2017,417:216-235.
[42]GUPTA D.Training primal K-nearest neighbor based weighted twin support vector regression via unconstrained convex minimization[J].Applied Intelligence,2017,47(3):962-991.
[43]GAO X,SUN Q,XU H.Multiple Instance Learning via Semi-supervised Laplacian TSVM[J].Neural Processing Letters,2017,46(1):219-232.
[44]TANVEER M,SHUBHAM K.A regularization on Lagrangian twin support vector regression[J].International Journal of Machine Learning & Cybernetics,2017,8(3):807-821.
[45]XU Y T.Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification[J].IEEE Transactions on Cybernetics,2017,47(6):1540-1550.
[46]SAIGAL P,KHANNA V.Divide and conquer approach for semi-supervised multi-category classification through localized kernel spectral clustering[J].Neurocomputing,2017,238:296-306.
[47]LI J,CAO Y,WANG Y,et al.Online Learning Algorithms for Double-Weighted Least Squares Twin Bounded Support Vector Machines[J].Neural Processing Letters,2017,45(1):319-339.
[48]PENG X,KONG L,CHEN D.A structural information-based twin-hypersphere support vector machine classifier[J].International Journal of Machine Learning & Cybernetics,2017,8(1):295-308.
[49]BALASUNDARAM S,GUPTA D,PRASAD S C.A new approach for training Lagrangian twin support vector machine via unconstrained convex minimization[J].Applied Intelligence,2017,46(1):124-134.
[50]PAN X,YANG Z,XU Y,et al.Safe Screening Rules for Acce- lerating Twin Support Vector Machine Classification[J].IEEE Transactions on Neural Networks & Learning Systems,2018,29(5):1876-1887.
[51]HAN R J,CAO Q L.Fuzzy chance constrained least squares twin support vector machine for uncertain classification[J].Journal of Inteligent & Fuzzy Systems,2017,33(5):3041-3049.
[52]XU Y T,YANG Z J,et al.A Novel Twin Support Vector Machine with Pinball Loss[J].IEEE Transactions on Neural Networks and Learning Systems,2017,28(2):359-370.
[53]CAO L,SHEN H.Imbalanced data classification based on hybrid resampling and twin support vector machine[J].Computer Science & Information Systems,2017,14(3):579-595.
[54]WANG H,ZHOU Z.An improved rough margin-based twin bounded support vector machine[M].Elsevier Science Publi-shers B.V.,2017:125-138.

Related Articles 15

[1]	LU Chen-yang, DENG Su, MA Wu-bin, WU Ya-hui, ZHOU Hao-hao. Federated Learning Based on Stratified Sampling Optimization for Heterogeneous Clients [J]. Computer Science, 2022, 49(9): 183-193.
[2]	LI Qi-ye, XING Hong-jie. KPCA Based Novelty Detection Method Using Maximum Correntropy Criterion [J]. Computer Science, 2022, 49(8): 267-272.
[3]	WANG Can, LIU Yong-jian, XIE Qing, MA Yan-chun. Anchor Free Object Detection Algorithm Based on Soft Label and Sample Weight Optimization [J]. Computer Science, 2022, 49(8): 157-164.
[4]	CHEN Jun, HE Qing, LI Shou-yu. Archimedes Optimization Algorithm Based on Adaptive Feedback Adjustment Factor [J]. Computer Science, 2022, 49(8): 237-246.
[5]	WANG Bing, WU Hong-liang, NIU Xin-zheng. Robot Path Planning Based on Improved Potential Field Method [J]. Computer Science, 2022, 49(7): 196-203.
[6]	TANG Feng, FENG Xiang, YU Hui-qun. Multi-task Cooperative Optimization Algorithm Based on Adaptive Knowledge Transfer andResource Allocation [J]. Computer Science, 2022, 49(7): 254-262.
[7]	ZHAO Dong-mei, WU Ya-xing, ZHANG Hong-bin. Network Security Situation Prediction Based on IPSO-BiLSTM [J]. Computer Science, 2022, 49(7): 357-362.
[8]	LI Ya-ru, ZHANG Yu-lai, WANG Jia-chen. Survey on Bayesian Optimization Methods for Hyper-parameter Tuning [J]. Computer Science, 2022, 49(6A): 86-92.
[9]	HOU Xia-ye, CHEN Hai-yan, ZHANG Bing, YUAN Li-gang, JIA Yi-zhen. Active Metric Learning Based on Support Vector Machines [J]. Computer Science, 2022, 49(6A): 113-118.
[10]	HUANG Guo-xing, YANG Ze-ming, LU Wei-dang, PENG Hong, WANG Jing-wen. Solve Data Envelopment Analysis Problems with Particle Filter [J]. Computer Science, 2022, 49(6A): 159-164.
[11]	CHEN Jun-wu, YU Hua-shan. Strategies for Improving Δ-stepping Algorithm on Scale-free Graphs [J]. Computer Science, 2022, 49(6A): 594-600.
[12]	LIU Zhang-hui, ZHENG Hong-qiang, ZHANG Jian-shan, CHEN Zhe-yi. Computation Offloading and Deployment Optimization in Multi-UAV-Enabled Mobile Edge Computing Systems [J]. Computer Science, 2022, 49(6A): 619-627.
[13]	FAN Xing-ze, YU Mei. Coverage Optimization of WSN Based on Improved Grey Wolf Optimizer [J]. Computer Science, 2022, 49(6A): 628-631.
[14]	ZHU Xu-hui, SHEN Guo-jiao, XIA Ping-fan, NI Zhi-wei. Model Based on Spirally Evolution Glowworm Swarm Optimization and Back Propagation Neural Network and Its Application in PPP Financing Risk Prediction [J]. Computer Science, 2022, 49(6A): 667-674.
[15]	WANG Xian-fang, ZHANG Liang, ZHANG Ning. Evolutionary Game Analysis of WeChat Health Information Quality Optimization Based on Prospect Theory [J]. Computer Science, 2022, 49(6A): 694-704.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

Twin Support Vector Machine:A Review

PDF (PC)