Computer Science ›› 2022, Vol. 49 ›› Issue (11A): 210800216-5.doi: 10.11896/jsjkx.210800216

• Big Data & Data Science • Previous Articles     Next Articles

Fuzzy Multiple Kernel Support Vector Machine Based on Weighted Mahalanobis Distance

DAI Xiao-lu, WANG Ting-hua, ZHOU Hui-ying   

  1. School of Mathematics and Computer Science,Gannan Normal University,Ganzhou,Jiangxi 341000,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:DAI Xiao-lu,born in 1997,postgra-duate.Her main research interests include machine learning and data mi-ning.
    WANG Ting-hua,born in 1977,Ph.D,professor,is a member of China Computer Federation.His main research interests include artificial intelligence and machine learning.
  • Supported by:
    National Natural Science Foundation of China(61966002) and Graduate Student Innovation Fund Project of Gannan Normal University(YCX20A019).

Abstract: Fuzzy support vector machine(FSVM) effectively distinguishes the importance of different samples by introducing fuzzy memberships,which reduces the sensitivity of traditional support vector machines to noise data.The membership function designed based on Euclidean distance ignores the overall distribution of samples and does not consider the different importance of sample features.A fuzzy support vector machine method based on weighted Mahalanobis distance is proposed.This method first applies the Relief-F algorithm to estimate the weight of each feature.Then it utilizes the weight for calculating the weighted Mahalanobis distance between the sample and the center of its class.Finally,the fuzzy membership of the sample is calculated based on weighted Mahalanobis distance.Furthermore,considering the difficulty of determining the kernel function and its parameters,a fuzzy multi-kernel support vector machine(FMKSVM) based on weighted Mahalanobis distance is put forward,which combines FSVM with multiple kernel learning methods.The multi-kernel is constructed in the form of weighted sum,and the weight of each kernel is calculated according to the central kernel alignment method(CKA).The proposed method not only reduces the influence of weakly relevant features on classification results,but also enables a more adequate and accurate representation of the data.Experimental results show that,FSVM based on weighted Mahalanobis distance has higher classification accuracy than FSVM based on Euclidean distance and Mahalanobis distance,and the classification performance of FMKSVM based on weighted Mahalanobis distance is superior to that of the single-kernel model.

Key words: Support vector machine, Centered kernel alignment, Weighted Mahalanobis distance, Multiple kernel learning, Membership function

CLC Number: 

  • TP181
[1]CORTES C,VAPNIK V N.Support-vector networks[J].Ma-chine Learning,1995,20(3):273-297.
[2]WANG M W,WAN Y C,YE Z W,et al.Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm[J].Information Sciences,2017,402(9):50-68.
[3]DAGHER I,DAHDAH E,SHAKIK M A.Facial expressionrecognition using three-stage support vector machines[J].VisualComputing for Industry Biomedicine and Art,2019,2(1):24.
[4]HOSSEINZADEH M,RAHMANI A M,VO B,et al.Improving security using SVM-based anomaly detection:issues and challenges[J].Soft Computing,2021,25(10):3195-3223.
[5]LIN C F,WANG S D.Fuzzy support vector machines [J].IEEE Transactions on Neural Networks,2002,13(2):464-471.
[6]JIAO Y P.Application of FSVM based onmahalanobis distance for user behavior recognition[J].Science & Technology Vision,2015,81(21):113-115.
[7]BACH F R,LANCKRIET G R G,JORDAN M I.Multiple kernel learning,conic duality,and the SMO algorithm[C]//Proceedings of the Twenty-First International Conference on Machine Learning.New York:Association for Computing Machi-nery,2004:41-48.
[8]WANG H Q,SUN F C,CAI Y N,et al.On multiple kernel learning methods[J].Acta Autumatica Sinica,2010,36(8):1037-1050.
[9]DAI X L,WANG T H,HU Z W.Research progress of fuzzy multiple kernel support vector machine[J].Application Research of Computers,2021,38(10):2896-2903.
[10]WANG T H,LU J,ZHANG G Q.Two-stage fuzzy multiple kernel learning based on hilbert-schmidt independence criterion[J].IEEE Transactions on Fuzzy Systems,2018,26(6):3703-3714.
[11]HE Q,ZHANG J Y.Kernel-target alignment multi-kernel fuzzy support vector machine[J].CAAI Transactions on Intelligent Systems,2019,14(6):1163-1169.
[12]WANG Z,WANG B L,CHENG Y,et al.Cost-sensitive fuzzy multiple kernel learning for imbalanced problem[J].Neurocomputing,2019,366(13):178-193.
[13]HE Q,ZHANG Q S,WANG H Y,et al.Local similarity-based fuzzy multiple kernel one-class support vector machine[J].Complexity,2020,2020(10):8853277.
[14]ZHANG Q S,HE Q,ZHANG C L,et al.Fuzzy multiple kernel one-class support vector machine[J].Journal of Beijing University of Civil Engineering and Architecture,2020,36(1):82-90.
[15]KIRA K,RENDELL L A.A practical approach to feature selection[J].Machine Learning Proceedings,1992,48(1):249-256.
[16]ZUO Y H,JIA L Y,YOU J G,et al.Classification algorithm of fuzzy support vector machine based on Relief-F feature weighting[J].Control and Instruments in Chemical Industry,2019,46(10):834-838,864.
[17]MA L L,GUO K J,WANG J Z.A fault diagnosis method of vehicle transmission system based on improved SVM[J].Transactions of Beijing Institute of Technology,2020,40(8):856-860.
[18]ZHOU Q,WU J W,FAN Y W,et al.Weighted linear multiple kernel learning for saliency detection[C]//Proceedings of the 2nd EAI International Conference on Robotic Sensor Networks.Cham:Kitakyushu,2020:201-213.
[19]WANG T H,QIU Y Z,HUA J L.Centered kernel alignment inspired fuzzy support vector machine[J].Fuzzy Sets and Systems,2020,394(9):110-123.
[20]DUA D,GRAFF C.UCI machine learning repository[EB/OL].http://archive.ics.uci.edu/ml.
[1] HOU Xia-ye, CHEN Hai-yan, ZHANG Bing, YUAN Li-gang, JIA Yi-zhen. Active Metric Learning Based on Support Vector Machines [J]. Computer Science, 2022, 49(6A): 113-118.
[2] SHAN Xiao-ying, REN Ying-chun. Fishing Type Identification of Marine Fishing Vessels Based on Support Vector Machine Optimized by Improved Sparrow Search Algorithm [J]. Computer Science, 2022, 49(6A): 211-216.
[3] CHEN Jing-nian. Acceleration of SVM for Multi-class Classification [J]. Computer Science, 2022, 49(6A): 297-300.
[4] XING Yun-bing, LONG Guang-yu, HU Chun-yu, HU Li-sha. Human Activity Recognition Method Based on Class Increment SVM [J]. Computer Science, 2022, 49(5): 78-83.
[5] GAO Ji-hang, ZHANG Yan. Fault Diagnosis of Shipboard Zonal Distribution Power System Based on FWA-PSO-MSVM [J]. Computer Science, 2022, 49(11A): 210800209-5.
[6] GUO Fu-min, ZHANG Hua, HU Rong-hua, SONG Yan. Study on Method for Estimating Wrist Muscle Force Based on Surface EMG Signals [J]. Computer Science, 2021, 48(6A): 317-320.
[7] ZHUO Ya-qian, OU Bo. Face Anti-spoofing Algorithm for Noisy Environment [J]. Computer Science, 2021, 48(6A): 443-447.
[8] LEI Jian-mei, ZENG Ling-qiu, MU Jie, CHEN Li-dong, WANG Cong, CHAI Yong. Reverse Diagnostic Method Based on Vehicle EMC Standard Test and Machine Learning [J]. Computer Science, 2021, 48(6): 190-195.
[9] WANG You-wei, ZHU Chen, ZHU Jian-ming, LI Yang, FENG Li-zhou, LIU Jiang-chun. User Interest Dictionary and LSTM Based Method for Personalized Emotion Classification [J]. Computer Science, 2021, 48(11A): 251-257.
[10] CAO Su-e, YANG Ze-min. Prediction of Wireless Network Traffic Based on Clustering Analysis and Optimized Support Vector Machine [J]. Computer Science, 2020, 47(8): 319-322.
[11] SONG Yan, HU Rong-hua, GUO Fu-min, YUAN Xin-liang and XIONG Rui-yang. Improved SVM+BP Algorithm for Muscle Force Prediction Based on sEMG [J]. Computer Science, 2020, 47(6A): 75-78.
[12] FANG Meng-lin, TANG Wen-bing, HUANG Hong-yun and DING Zuo-hua. Wall-following Navigation of Mobile Robot Based on Fuzzy-based Information Decomposition and Control Rules [J]. Computer Science, 2020, 47(6A): 79-83.
[13] XU Xiang-yan and HOU Rui-huan. Medium and Long-term Population Prediction Based on GM(1,1)-SVM Combination Model [J]. Computer Science, 2020, 47(6A): 485-487.
[14] PAN Heng, LI Jing feng, MA Jun hu. Role Dynamic Adjustment Algorithm for Resisting Insider Threat [J]. Computer Science, 2020, 47(5): 313-318.
[15] YANG Li, LI Xin-yu, SHI Huai-feng, PAN Cheng-sheng. Task Intelligent Identification Method for Spatial Information Network [J]. Computer Science, 2020, 47(4): 262-269.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!