计算机科学 ›› 2022, Vol. 49 ›› Issue (11A): 210800216-5.doi: 10.11896/jsjkx.210800216

• 大数据&数据科学 • 上一篇    下一篇

基于加权马氏距离的模糊多核支持向量机

戴小路, 汪廷华, 周慧颖   

  1. 赣南师范大学数学与计算机科学学院 江西 赣州 341000
  • 出版日期:2022-11-10 发布日期:2022-11-21
  • 通讯作者: 汪廷华(wthpku@163.com)
  • 作者简介:(1353119318@qq.com)
  • 基金资助:
    国家自然科学基金(61966002);赣南师范大学研究生创新基金项目(YCX20A019)

Fuzzy Multiple Kernel Support Vector Machine Based on Weighted Mahalanobis Distance

DAI Xiao-lu, WANG Ting-hua, ZHOU Hui-ying   

  1. School of Mathematics and Computer Science,Gannan Normal University,Ganzhou,Jiangxi 341000,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:DAI Xiao-lu,born in 1997,postgra-duate.Her main research interests include machine learning and data mi-ning.
    WANG Ting-hua,born in 1977,Ph.D,professor,is a member of China Computer Federation.His main research interests include artificial intelligence and machine learning.
  • Supported by:
    National Natural Science Foundation of China(61966002) and Graduate Student Innovation Fund Project of Gannan Normal University(YCX20A019).

摘要: 模糊支持向量机通过引入模糊隶属度有效区分不同样本的重要程度,降低了传统支持向量机对噪声数据的敏感性。针对基于欧氏距离设计的隶属度函数忽略了样本的总体分布,且未考虑样本特征重要性的区分,提出了一种基于加权马氏距离的模糊支持向量机方法。首先应用Relief-F算法计算样本特征权重,然后基于该权重计算样本距其类中心的加权马氏距离,最后根据该距离值度量样本隶属度。在此基础上,考虑到核函数及其核参数难以确定,将模糊支持向量机与多核学习方法相结合,提出基于加权马氏距离的模糊多核支持向量机,采用加权求和形式构建多核,并遵循中心核对齐原则确定每个核的权重。该方法不仅降低了弱相关特征对分类效果的影响,而且使数据表达更加全面准确。实验结果表明,基于加权马氏距离的模糊支持向量机的分类精度高于基于欧氏距离和基于马氏距离的模糊支持向量机,且基于加权马氏距离的模糊多核支持向量机的分类性能较单核模型更优。

关键词: 支持向量机, 中心核对齐, 加权马氏距离, 多核学习, 隶属度函数

Abstract: Fuzzy support vector machine(FSVM) effectively distinguishes the importance of different samples by introducing fuzzy memberships,which reduces the sensitivity of traditional support vector machines to noise data.The membership function designed based on Euclidean distance ignores the overall distribution of samples and does not consider the different importance of sample features.A fuzzy support vector machine method based on weighted Mahalanobis distance is proposed.This method first applies the Relief-F algorithm to estimate the weight of each feature.Then it utilizes the weight for calculating the weighted Mahalanobis distance between the sample and the center of its class.Finally,the fuzzy membership of the sample is calculated based on weighted Mahalanobis distance.Furthermore,considering the difficulty of determining the kernel function and its parameters,a fuzzy multi-kernel support vector machine(FMKSVM) based on weighted Mahalanobis distance is put forward,which combines FSVM with multiple kernel learning methods.The multi-kernel is constructed in the form of weighted sum,and the weight of each kernel is calculated according to the central kernel alignment method(CKA).The proposed method not only reduces the influence of weakly relevant features on classification results,but also enables a more adequate and accurate representation of the data.Experimental results show that,FSVM based on weighted Mahalanobis distance has higher classification accuracy than FSVM based on Euclidean distance and Mahalanobis distance,and the classification performance of FMKSVM based on weighted Mahalanobis distance is superior to that of the single-kernel model.

Key words: Support vector machine, Centered kernel alignment, Weighted Mahalanobis distance, Multiple kernel learning, Membership function

中图分类号: 

  • TP181
[1]CORTES C,VAPNIK V N.Support-vector networks[J].Ma-chine Learning,1995,20(3):273-297.
[2]WANG M W,WAN Y C,YE Z W,et al.Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm[J].Information Sciences,2017,402(9):50-68.
[3]DAGHER I,DAHDAH E,SHAKIK M A.Facial expressionrecognition using three-stage support vector machines[J].VisualComputing for Industry Biomedicine and Art,2019,2(1):24.
[4]HOSSEINZADEH M,RAHMANI A M,VO B,et al.Improving security using SVM-based anomaly detection:issues and challenges[J].Soft Computing,2021,25(10):3195-3223.
[5]LIN C F,WANG S D.Fuzzy support vector machines [J].IEEE Transactions on Neural Networks,2002,13(2):464-471.
[6]JIAO Y P.Application of FSVM based onmahalanobis distance for user behavior recognition[J].Science & Technology Vision,2015,81(21):113-115.
[7]BACH F R,LANCKRIET G R G,JORDAN M I.Multiple kernel learning,conic duality,and the SMO algorithm[C]//Proceedings of the Twenty-First International Conference on Machine Learning.New York:Association for Computing Machi-nery,2004:41-48.
[8]WANG H Q,SUN F C,CAI Y N,et al.On multiple kernel learning methods[J].Acta Autumatica Sinica,2010,36(8):1037-1050.
[9]DAI X L,WANG T H,HU Z W.Research progress of fuzzy multiple kernel support vector machine[J].Application Research of Computers,2021,38(10):2896-2903.
[10]WANG T H,LU J,ZHANG G Q.Two-stage fuzzy multiple kernel learning based on hilbert-schmidt independence criterion[J].IEEE Transactions on Fuzzy Systems,2018,26(6):3703-3714.
[11]HE Q,ZHANG J Y.Kernel-target alignment multi-kernel fuzzy support vector machine[J].CAAI Transactions on Intelligent Systems,2019,14(6):1163-1169.
[12]WANG Z,WANG B L,CHENG Y,et al.Cost-sensitive fuzzy multiple kernel learning for imbalanced problem[J].Neurocomputing,2019,366(13):178-193.
[13]HE Q,ZHANG Q S,WANG H Y,et al.Local similarity-based fuzzy multiple kernel one-class support vector machine[J].Complexity,2020,2020(10):8853277.
[14]ZHANG Q S,HE Q,ZHANG C L,et al.Fuzzy multiple kernel one-class support vector machine[J].Journal of Beijing University of Civil Engineering and Architecture,2020,36(1):82-90.
[15]KIRA K,RENDELL L A.A practical approach to feature selection[J].Machine Learning Proceedings,1992,48(1):249-256.
[16]ZUO Y H,JIA L Y,YOU J G,et al.Classification algorithm of fuzzy support vector machine based on Relief-F feature weighting[J].Control and Instruments in Chemical Industry,2019,46(10):834-838,864.
[17]MA L L,GUO K J,WANG J Z.A fault diagnosis method of vehicle transmission system based on improved SVM[J].Transactions of Beijing Institute of Technology,2020,40(8):856-860.
[18]ZHOU Q,WU J W,FAN Y W,et al.Weighted linear multiple kernel learning for saliency detection[C]//Proceedings of the 2nd EAI International Conference on Robotic Sensor Networks.Cham:Kitakyushu,2020:201-213.
[19]WANG T H,QIU Y Z,HUA J L.Centered kernel alignment inspired fuzzy support vector machine[J].Fuzzy Sets and Systems,2020,394(9):110-123.
[20]DUA D,GRAFF C.UCI machine learning repository[EB/OL].http://archive.ics.uci.edu/ml.
[1] 侯夏晔, 陈海燕, 张兵, 袁立罡, 贾亦真.
一种基于支持向量机的主动度量学习算法
Active Metric Learning Based on Support Vector Machines
计算机科学, 2022, 49(6A): 113-118. https://doi.org/10.11896/jsjkx.210500034
[2] 单晓英, 任迎春.
基于改进麻雀搜索优化支持向量机的渔船捕捞方式识别
Fishing Type Identification of Marine Fishing Vessels Based on Support Vector Machine Optimized by Improved Sparrow Search Algorithm
计算机科学, 2022, 49(6A): 211-216. https://doi.org/10.11896/jsjkx.220300216
[3] 陈景年.
一种适于多分类问题的支持向量机加速方法
Acceleration of SVM for Multi-class Classification
计算机科学, 2022, 49(6A): 297-300. https://doi.org/10.11896/jsjkx.210400149
[4] 邢云冰, 龙广玉, 胡春雨, 忽丽莎.
基于SVM的类别增量人体活动识别方法
Human Activity Recognition Method Based on Class Increment SVM
计算机科学, 2022, 49(5): 78-83. https://doi.org/10.11896/jsjkx.210400024
[5] 武玉坤, 李伟, 倪敏雅, 许志骋.
单类支持向量机融合深度自编码器的异常检测模型
Anomaly Detection Model Based on One-class Support Vector Machine Fused Deep Auto-encoder
计算机科学, 2022, 49(3): 144-151. https://doi.org/10.11896/jsjkx.210100142
[6] 高际航, 张艳.
基于FWA-PSO-MSVM的船舶区域配电电力系统故障诊断
Fault Diagnosis of Shipboard Zonal Distribution Power System Based on FWA-PSO-MSVM
计算机科学, 2022, 49(11A): 210800209-5. https://doi.org/10.11896/jsjkx.210800209
[7] 侯春萍, 赵春月, 王致芃.
基于自反馈最优子类挖掘的视频异常检测算法
Video Abnormal Event Detection Algorithm Based on Self-feedback Optimal Subclass Mining
计算机科学, 2021, 48(7): 199-205. https://doi.org/10.11896/jsjkx.200800146
[8] 郭福民, 张华, 胡瑢华, 宋岩.
一种基于表面肌电信号的腕部肌力估计方法研究
Study on Method for Estimating Wrist Muscle Force Based on Surface EMG Signals
计算机科学, 2021, 48(6A): 317-320. https://doi.org/10.11896/jsjkx.200600021
[9] 卓雅倩, 欧博.
噪声环境下的人脸防伪识别算法研究
Face Anti-spoofing Algorithm for Noisy Environment
计算机科学, 2021, 48(6A): 443-447. https://doi.org/10.11896/jsjkx.200900207
[10] 雷剑梅, 曾令秋, 牟洁, 陈立东, 王淙, 柴勇.
基于整车EMC标准测试和机器学习的反向诊断方法
Reverse Diagnostic Method Based on Vehicle EMC Standard Test and Machine Learning
计算机科学, 2021, 48(6): 190-195. https://doi.org/10.11896/jsjkx.200700204
[11] 王友卫, 朱晨, 朱建明, 李洋, 凤丽洲, 刘江淳.
基于用户兴趣词典和LSTM的个性化情感分类方法
User Interest Dictionary and LSTM Based Method for Personalized Emotion Classification
计算机科学, 2021, 48(11A): 251-257. https://doi.org/10.11896/jsjkx.201200202
[12] 曹素娥, 杨泽民.
基于聚类分析算法和优化支持向量机的无线网络流量预测
Prediction of Wireless Network Traffic Based on Clustering Analysis and Optimized Support Vector Machine
计算机科学, 2020, 47(8): 319-322. https://doi.org/10.11896/jsjkx.190800075
[13] 宋岩, 胡瑢华, 郭福民, 袁新亮, 熊睿洋.
基于sEMG的改进SVM+BP肌力预测分层算法
Improved SVM+BP Algorithm for Muscle Force Prediction Based on sEMG
计算机科学, 2020, 47(6A): 75-78. https://doi.org/10.11896/JsJkx.190900143
[14] 方梦琳, 唐文兵, 黄鸿云, 丁佐华.
基于模糊信息分解与控制规则的移动机器人沿墙导航
Wall-following Navigation of Mobile Robot Based on Fuzzy-based Information Decomposition and Control Rules
计算机科学, 2020, 47(6A): 79-83. https://doi.org/10.11896/JsJkx.191000158
[15] 徐翔燕, 侯瑞环.
基于GM(1,1)-SVM组合模型的中长期人口预测研究
Medium and Long-term Population Prediction Based on GM(1,1)-SVM Combination Model
计算机科学, 2020, 47(6A): 485-487. https://doi.org/10.11896/JsJkx.190900168
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!