计算机科学 ›› 2021, Vol. 48 ›› Issue (6A): 270-274.doi: 10.11896/jsjkx.200700036

• 智能计算 • 上一篇    下一篇

基于直觉模糊集的集成学习算法

戴宗明, 胡凯, 谢捷, 郭亚   

  1. 江南大学轻工业先进过程控制教育部重点实验室 江苏 无锡214122
    江南大学物联网工程学院 江苏 无锡214122
  • 出版日期:2021-06-10 发布日期:2021-06-17
  • 通讯作者: 郭亚(guoy@jiangnan.edu.cn)
  • 作者简介:dzm_1995@163.com
  • 基金资助:
    国家自然科学基金项目(71904064);测绘遥感信息工程国家重点实验室重点开放基金项目(18I04);江苏省自然科学基金(BK20190580);中央高校自主科研基金青年项目(JUSRP11922)

Ensemble Learning Algorithm Based on Intuitionistic Fuzzy Sets

DAI Zong-ming, HU Kai, XIE Jie, GUO Ya   

  1. Key Laboratory of Advanced Process Control for Light Industry,Ministry of Education,Jiangnan University,Wuxi,Jiangsu 214122,China
    School of Internet of Things,Jiangnan University,Wuxi,Jiangsu 214122,China
  • Online:2021-06-10 Published:2021-06-17
  • About author:DAI Zong-ming,born in 1995,postgra-duate.His main research interests include text classification and fuzzy decision.
    GUO Ya,born in 1977,Ph.D,professor,Ph.D supervisor.His main research interests include system modeling and control,and deep learning.
  • Supported by:
    National Natural Science Foundation of China(71904064),Open Research Fund of State Laboratory of Information Engineering in Surveying,the Mapping and Remote Sensing,Wuhan University(18I04),Natural Science Foundation of Jiangsu Province(BK20190580) and 111 Project and the Fundamental Research Funds for the Central Universities(JUSRP11922).

摘要: 为提高传统机器学习算法的分类精度和泛化能力,提出一种基于直觉模糊集的集成学习算法。根据传统分类器分类精度构建直觉模糊偏好关系矩阵,确定分类器权重,结合多属性群决策方法确定样本分类结果。在UCI中的7个数据集上进行测试,与目前流行的传统分类算法以及集成学习分类算法SVM,LR,NB,Boosting,Bagging相比,提出的算法分类平均精度分别提升了1.91%,3.89%,7.80%,3.66%,4.72%。该算法提高了传统分类方法的分类精度和泛化能力。

关键词: 多属性群决策, 分类, 集成学习, 直觉模糊集

Abstract: In order to improve the classification accuracy and generalization ability of traditional machine learning algorithms,this paper proposes an ensemble learning algorithm based on intuitionistic fuzzy sets (IFS-EL).The algorithm constructs an intuitionistic fuzzy preference relation (IFPR) matrix according to the classification accuracy of the traditional classifier.The matrix is used to determine the weights of the classifiers and the multi-criteria group decision making (MCGDM) is used to determine the sample classification result.The experimental data uses 7 classification data sets in UCI,and the training set and test set are divided into 7:3.The classification results are compared with the current popular traditional classification algorithms and ensemble learning classification algorithms,SVM,LR,NB,Boosting,Bagging,the average accuracy of the algorithm in this paper is improved by 1.91%,3.89%,7.80%,3.66%,4.72%.The experimental results show that the IFS-EL can improve the classification accuracy and generalization ability.

Key words: Classification, Ensemble learning, Intuitionistic fuzzy sets, Multi-criteria group decision making

中图分类号: 

  • TP301.6
[1] HE Q,LI N,LUO W J,et al.A Survey of Machine Learning Algorithms for Big Data[J].Pattern Recognition and Artificial Intelligence,2014,27(4):327-336.
[2] DIETTERICH T G.Machine-learning research-Four current directions[J].Ai Magazine,1997,18(4):97-136.
[3] SCHAPIRE R E.The strength of weak learnability [J].Proceedings of the Second Annual Workshop on Computational Learning Theory,1989,5(2):197-227.
[4] BREIMAN L.Bagging predictors[J].Machine Learning,1996,24(2):123-140.
[5] BAUER E,KOHAVI R.An Empirical Comparison of VotingClassification Algorithms:Bagging,Boosting,and Variants[J].Machine Learning,1999,36(1):105-139.
[6] JIANG Y,CHEN N,MING L T,et al.Bagging-based Probabilistic Neural Network Ensemble Classification Algorithm[J].Computer Science,2013,40(5):242-246.
[7] ZADEH L A.Fuzzy Sets[J].Information & Control,1965,8(3):338-353.
[8] XU J,SUN G,ZHAO J.Novel Correlation Coefficients Between Hesitant Fuzzy Sets and Their Applications in Multi-attribute Decision Making[J].Acta Electronica Sinica,2018,46(6):1327-1335.
[9] CHEN Y B,LIU P D.Multi-attribute decision-making approach based on intuitionistic trapezoidal fuzzy generalized heronian OWA operator[J].Journal of Intelligent & Fuzzy Systems,2014,27(3):1381-1392.
[10] XU Z S,YAGER R R.Dynamic intuitionistic fuzzy multi-attribute decision making[J].International Journal of Approximate Reasoning,2008,48(1):246-262.
[11] ZHANG X M,XU Z S.A new method for ranking intuitionistic fuzzy values and its application in multi-attribute decision ma-king[J].Fuzzy Optimization and Decision Making,2012,11(2):135-146.
[12] SAATY T L.An exposition of the AHP in reply to the paper “remarks on the analytic hierarchy process”[J].Management Science,1990,36(3):259-268.
[13] LAI H F.Applying fuzzy AHP to evaluate the sustainability of knowledge-based virtual communities in healthcare industry[C]//Proceedings of the International Conference on Service Systems and Service Management.2010.
[14] LIAO H,XU Z.Consistency of the fused intuitionistic fuzzypreference relation in group intuitionistic fuzzy analytic hierarchy process [J].Applied Soft Computing,2015,35:812-826.
[15] DING S F,QI B J,TAN H Y.An Overview on Theory and Algorithm of Support Vector Machines[J].Journal of University of Electronic Science and Technology of China,2011,40(1):1-10.
[16] SUN A,LIM E P,LIU Y.On strategies for imbalanced textclassification using SVM:A comparative study[J].Decision Support Systems,2010,48(1):191-201.
[17] JIANG L X.Research on Naïve Bayes Classifiers and Its Improved Algorithms[D].China University of Geosciences,2009.
[18] JIANG G H,ZHANG F R,CHEN J W,et al.Analysis of the driving forces of change of rural residential areas in Beijing mountainousareas based on Logistic regression model[J].Transactions of the Chinese Society of Agricultural Enginee-ring,2007,5:81-87.
[19] KHAN N M,KSANTINI R,AHMAD I S,et al.Covariance-guided One-Class Support Vector Machine[J].Pattern Recognition,2014,47(6):2165-2177.
[20] FREUND Y,SCHAPIRE R E.A decision-theoretic generalization of on-line learning and an application to boosting[J] Journal of Computer and System Sciences,1997,55(1):119-139.
[21] WANG L L.Research on Ensemble Learming Algorithm[D].Guangxi University,2006.
[22] SHEN X H,ZHOU Z H,WU J X,et al.Survey of Boosting and Bagging[J].Computer Engineering and Applications,2000,12:31-32,40.
[23] ATANASSOV K T.On Intuitionistic Fuzzy Sets Theory[M].Springer Berlin Heidelberg,2012.
[24] XU X S.Approaches to Multiple Attribute Decision Makingwith Intuitionistic Fuzzy Preference Information[J].Systems Engineering-Theory & Practice,2007,11:62-71.
[25] XU Z S,SUN Z D.A Method Based on Satisfactory Degree of Alternative for Uncertainly Multi-Attribution Decision-Making[J].Systems Engineering,2001,3:76-79.
[26] XU Z.A survey of preference relations[J].International Journal of General Systems,2007,36(2):179-203.
[27] BUSTINCE H,PAGOLA M,MESIAR R,et al.Grouping,Overlap,and Generalized Bientropic Functions for Fuzzy Modeling of Pairwise Comparisons[J].IEEE Transactions on Fuzzy Systems,2012,20(3):405-415.
[28] XU Z.Intuitionistic preference relations and their application in group decision making[J].Information Sciences,2007,177(11):2363-2379.
[29] MOU Q,XU Z S,LIAO H C.A graph based group decisionmaking approach with intuitionistic fuzzy preference relations[J].Computers & Industrial Engineering,2017,110:138-150.
[30] DUA D,GRAFF C.UCI Machine Learning Repository[D].School of Information and Computer Sciences,2017.
[1] 陈志强, 韩萌, 李慕航, 武红鑫, 张喜龙.
数据流概念漂移处理方法研究综述
Survey of Concept Drift Handling Methods in Data Streams
计算机科学, 2022, 49(9): 14-32. https://doi.org/10.11896/jsjkx.210700112
[2] 周旭, 钱胜胜, 李章明, 方全, 徐常胜.
基于对偶变分多模态注意力网络的不完备社会事件分类方法
Dual Variational Multi-modal Attention Network for Incomplete Social Event Classification
计算机科学, 2022, 49(9): 132-138. https://doi.org/10.11896/jsjkx.220600022
[3] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[4] 武红鑫, 韩萌, 陈志强, 张喜龙, 李慕航.
监督和半监督学习下的多标签分类综述
Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning
计算机科学, 2022, 49(8): 12-25. https://doi.org/10.11896/jsjkx.210700111
[5] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[6] 闫佳丹, 贾彩燕.
基于双图神经网络信息融合的文本分类方法
Text Classification Method Based on Information Fusion of Dual-graph Neural Network
计算机科学, 2022, 49(8): 230-236. https://doi.org/10.11896/jsjkx.210600042
[7] 高振卓, 王志海, 刘海洋.
嵌入典型时间序列特征的随机Shapelet森林算法
Random Shapelet Forest Algorithm Embedded with Canonical Time Series Features
计算机科学, 2022, 49(7): 40-49. https://doi.org/10.11896/jsjkx.210700226
[8] 杨炳新, 郭艳蓉, 郝世杰, 洪日昌.
基于数据增广和模型集成策略的图神经网络在抑郁症识别上的应用
Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition
计算机科学, 2022, 49(7): 57-63. https://doi.org/10.11896/jsjkx.210800070
[9] 张洪博, 董力嘉, 潘玉彪, 萧宗志, 张惠臻, 杜吉祥.
视频理解中的动作质量评估方法综述
Survey on Action Quality Assessment Methods in Video Understanding
计算机科学, 2022, 49(7): 79-88. https://doi.org/10.11896/jsjkx.210600028
[10] 杜丽君, 唐玺璐, 周娇, 陈玉兰, 程建.
基于注意力机制和多任务学习的阿尔茨海默症分类
Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning
计算机科学, 2022, 49(6A): 60-65. https://doi.org/10.11896/jsjkx.201200072
[11] 李小伟, 舒辉, 光焱, 翟懿, 杨资集.
自然语言处理在简历分析中的应用研究综述
Survey of the Application of Natural Language Processing for Resume Analysis
计算机科学, 2022, 49(6A): 66-73. https://doi.org/10.11896/jsjkx.210600134
[12] 邓凯, 杨频, 李益洲, 杨星, 曾凡瑞, 张振毓.
一种可快速迁移的领域知识图谱构建方法
Fast and Transmissible Domain Knowledge Graph Construction Method
计算机科学, 2022, 49(6A): 100-108. https://doi.org/10.11896/jsjkx.210900018
[13] 黄少滨, 孙雪薇, 李熔盛.
基于跨句上下文信息的神经网络关系分类方法
Relation Classification Method Based on Cross-sentence Contextual Information for Neural Network
计算机科学, 2022, 49(6A): 119-124. https://doi.org/10.11896/jsjkx.210600150
[14] 林夕, 陈孜卓, 王中卿.
基于不平衡数据与集成学习的属性级情感分类
Aspect-level Sentiment Classification Based on Imbalanced Data and Ensemble Learning
计算机科学, 2022, 49(6A): 144-149. https://doi.org/10.11896/jsjkx.210500205
[15] 康雁, 吴志伟, 寇勇奇, 张兰, 谢思宇, 李浩.
融合Bert和图卷积的深度集成学习软件需求分类
Deep Integrated Learning Software Requirement Classification Fusing Bert and Graph Convolution
计算机科学, 2022, 49(6A): 150-158. https://doi.org/10.11896/jsjkx.210500065
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!