Computer Science ›› 2018, Vol. 45 ›› Issue (12): 182-186.doi: 10.11896/j.issn.1002-137X.2018.12.029

• Artificial Intelligence • Previous Articles     Next Articles

Weighted Support Vector Machine Algorithm Based on Inner-correlations and Mutual Information of Features

PENG Xiao-bing1,2, ZHU Yu-quan1   

  1. (School of Computer Science and Communication Engineering,Jiangsu University,Zhenjiang,Jiangsu 212013,China)1
    (Information Center,Jiangsu University,Zhenjiang,Jiangsu 212013,China)2
  • Received:2017-11-28 Online:2018-12-15 Published:2019-02-25

Abstract: The feature-weighted support vector machine (FWSVM) does not take into account the correlation among the features,thus the redundancy and the interference caused by it will have a negative impact on the final classification result.A feature weighting algorithm based on inner-feature correlation and mutual information was proposed and applied in support vector machines.The algorithm introduces the inter-feature coefficient as an index to measure the redundancy,and then calculates the penalty factor to deal with the weight on the basis of the feature weighting vector machine.Thus it realizes the contribution of the feature to the classification as much as possible.The comparison of experiments on multiple data sets with several different algorithms shows that the proposed new algorithm has better robustness and generalization ability.

Key words: Correlation coefficient, Feature weighting, Mutual information, Penalty factor, Support vector machine

CLC Number: 

  • TP309
[1]BUTT K J.A study of feature selection algorithms for accuracy estimation.Ajr American Journal of Roentgenology,2012,149(6):1155-1160.
[2]IQBAL R A.Empirical Learning Aided by Weak DomainKnowledge in the Form of Feature Importance[C]∥International Conference on Multimedia and Signal Processing.IEEE Computer Society,2011:126-130.
[3]ZHANG L,WANG Z.Ontology-based Clustering Algorithmwith Feature Weights.Journal of Computational Information Systems,2010,6(9):2959-2966.
[4]WANG T H,TIAN S F,HUANG H K.Feature Weighted Support Vector Machine.Journal of Electronics & Information Technology,2009,31(3):514-518.(in Chinese)
汪廷华,田盛丰,黄厚宽.特征加权支持向量机.电子与信息学报,2009,31(3):514-518.
[5]WALTON S,HASSAN O,MORGAN K,et al.Modified cuckoo search:A new gradient free optimisation algorithm[J].Chaos,Solitons & Fractals,2011,44(9):710-718.
[6]SHANNON C E.A mathematical theory of communication.Bell System Techical Journal,1948,27(3):379-423,623-656.
[7]MALIK H H,FRADKIN D,MOERCHEN F.Single pass text classification by direct feature weighting.Knowledge & Information Systems,2011,28(1):79-98.
[8]GIVEKI D,SALIMI H,BAHMANYAR G R,et al.Automatic Detection of Diabetes Diagnosis using Feature Weighted Support Vector Machines based on Mutual Information and Modified Cuckoo Search.Computer Science,2012,abs/1201.2173.
[9]XING H J,HA M H,HU B G,et al.Linear feature-weighted support vector machine[J].Fuzzy Information and Engineering 2009,1(3):289-305.
[10]SHANNON C E,WEAVER W.The Mathematical Theory of Communication.Urbana:University of Illinois Press,1949.
[11]CHEN Y,HAO Y.A Feature Weighted Support Vector Ma-chine and K-Nearest Neighbor Algorithm for Stock Market Indices Prediction.Expert Systems with Applications,2017,80:340-355.
[12]IQBAL R A.Using Feature Weights to Improve Performance of Neural Networks.http://arXiv:1101.4918.
[13]LIU L,ZHANG J,LI P,et al.A Label Correlation Based Weighting Feature Selection Approach for Multi-label Data.Berlin:Springer International Publishing,2016:369-379.
[14]WANG Y,LI T.Feature and Sample Weighted Support Vector Machine∥Knowledge Engineering and Management.Springer Berlin Heidelberg,2011:365-371.
[15]GAO Y L,LIU Y X.An improved feature-weighted methodbased on K-NN[C]∥Control Conference.IEEE,2016:6950-6956.
[16]WOLFEL M,EKENEL H K.Feature weighted mahalanobisdistance:Improved robustness for Gaussian classifiers[C]∥13th European Signal Processing Conference.IEEE,2005:2018-2021.
[17]JIA G,ZHAO H,PAN Z,et al.Local Feature Weighting for Data Classification∥ransactions on Edutainment XIII.Sprin-ger Berlin Heidelberg,2017:293-302.
[1] SHAN Xiao-ying, REN Ying-chun. Fishing Type Identification of Marine Fishing Vessels Based on Support Vector Machine Optimized by Improved Sparrow Search Algorithm [J]. Computer Science, 2022, 49(6A): 211-216.
[2] CHEN Jing-nian. Acceleration of SVM for Multi-class Classification [J]. Computer Science, 2022, 49(6A): 297-300.
[3] HOU Xia-ye, CHEN Hai-yan, ZHANG Bing, YUAN Li-gang, JIA Yi-zhen. Active Metric Learning Based on Support Vector Machines [J]. Computer Science, 2022, 49(6A): 113-118.
[4] XING Yun-bing, LONG Guang-yu, HU Chun-yu, HU Li-sha. Human Activity Recognition Method Based on Class Increment SVM [J]. Computer Science, 2022, 49(5): 78-83.
[5] GUO Fu-min, ZHANG Hua, HU Rong-hua, SONG Yan. Study on Method for Estimating Wrist Muscle Force Based on Surface EMG Signals [J]. Computer Science, 2021, 48(6A): 317-320.
[6] ZHUO Ya-qian, OU Bo. Face Anti-spoofing Algorithm for Noisy Environment [J]. Computer Science, 2021, 48(6A): 443-447.
[7] LUO Jing-jing, TANG Wei-zhen, DING Ji-ting. Research of ATC Simulator Training Values Independence Based on Pearson Correlation Coefficient and Study of Data Visualization Based on Factor Analysis [J]. Computer Science, 2021, 48(6A): 623-628.
[8] LEI Jian-mei, ZENG Ling-qiu, MU Jie, CHEN Li-dong, WANG Cong, CHAI Yong. Reverse Diagnostic Method Based on Vehicle EMC Standard Test and Machine Learning [J]. Computer Science, 2021, 48(6): 190-195.
[9] WANG Yi-hao, DING Hong-wei, LI Bo, BAO Li-yong, ZHANG Ying-jie. Prediction of Protein Subcellular Localization Based on Clustering and Feature Fusion [J]. Computer Science, 2021, 48(3): 206-213.
[10] WANG You-wei, ZHU Chen, ZHU Jian-ming, LI Yang, FENG Li-zhou, LIU Jiang-chun. User Interest Dictionary and LSTM Based Method for Personalized Emotion Classification [J]. Computer Science, 2021, 48(11A): 251-257.
[11] LEI Yang, JIANG Ying. Anomaly Judgment of Directly Associated Nodes Under Cloud Computing Environment [J]. Computer Science, 2021, 48(1): 295-300.
[12] CAO Su-e, YANG Ze-min. Prediction of Wireless Network Traffic Based on Clustering Analysis and Optimized Support Vector Machine [J]. Computer Science, 2020, 47(8): 319-322.
[13] XU Xiang-yan and HOU Rui-huan. Medium and Long-term Population Prediction Based on GM(1,1)-SVM Combination Model [J]. Computer Science, 2020, 47(6A): 485-487.
[14] SONG Yan, HU Rong-hua, GUO Fu-min, YUAN Xin-liang and XIONG Rui-yang. Improved SVM+BP Algorithm for Muscle Force Prediction Based on sEMG [J]. Computer Science, 2020, 47(6A): 75-78.
[15] FANG Meng-lin, TANG Wen-bing, HUANG Hong-yun and DING Zuo-hua. Wall-following Navigation of Mobile Robot Based on Fuzzy-based Information Decomposition and Control Rules [J]. Computer Science, 2020, 47(6A): 79-83.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!