Computer Science ›› 2017, Vol. 44 ›› Issue (1): 48-52.doi: 10.11896/j.issn.1002-137X.2017.01.009

Previous Articles     Next Articles

Selective Ensemble Learning Algorithm Based on Hierarchical Selection and Dynamic Updating in Parallel

WU Mei-hong, GUO Jia-sheng, JU Ying, LIN Zi-yu and ZOU Quan   

  • Online:2018-11-13 Published:2018-11-13

Abstract: In this paper,a selective ensemble learning algorithm was proposed based on hierarchical selection and dynamic updating,which can optimize the parameters of classifier with multi-thread technique and select the sub sequence set of classifiers based on hierarchical selection and dynamical information.It can solve the problem in the past for choosing classifier to ensemble learning inefficiently.In addition,divide-and-conquer strategy is employed to reduce the time cost for ensemble voting.The big voting task can be divided recursively into small child task by dichotomy,then the tasks are executed in parallel and it would conquer the voting result.Experimental results show that the selective algorithm can outperform the traditional classification algorithms on F1-Measure and AUC.

Key words: Selective ensemble learning,Divide-and-conquer,Parallel computation,Classification

[1] ZHANG Min-ling,ZHOU Zhi-hua.A review on multi-labellearning algorithms [J].IEEE Transactions on Knowledge and Data Engineering,2014,26(8):1819-1837.
[2] WEI Le-yi,LIAO Ming-hong,GAO Yue,et al.Improved andPromising Identification of Human MicroRNAs by Incorporating a High-quality Negative Set [J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2014,11(1):192-201.
[3] HU Yao,JIN Zhong-ming,SHI Yi,et al.Large scale multi-class classification with truncated nuclear norm regularization [J].Neurocomputing,2015,148:310-317.
[4] DENG Chao,GUO Mao-zu.Tri-training and data editing based semi-supervised clustering algorithm [J].Journal of Software,2008,19(3):663-673.(in Chinese) 邓超,郭茂祖.基于 Tri-Training 和数据剪辑的半监督聚类算法[J].软件学报,2008,19(3):663-673 .
[5] ZHANG Chun-xia.A Survey of Selective Ensemble Learning Al-gorithms [J].Chinese Journal of Computers,2011,4(8):1399-1410.(in Chinese) 张春霞.选择性集成学习算法综述.计算机学报[J],2011,4(8):1399-1410.
[6] LEOoB.Bagging predictors [J].Machine learning,1996,24(2):123-140.
[7] RTSCH,GUNNAR,ONODA T,et al.Soft margins for AdaBoost [J].Machine learning,2001,42(3):287-320.
[8] ROBERT S.The strength of weak learnability[J].MachineLearning,1990,5(2):197-227.
[9] YOAV F.Boosting a weak learning algorithm by majority [J].Information and Computation,1995,121(2):256-285.
[10] LIN Chen,CHEN Wen-qiang,QIU Cheng,et al.LibD3C:Ensemble classifiers with a clustering and dynamic selection strategy [J].Neurocomputing,2014,3:424-435.
[11] ZHOU Zhi-hua,WU Jian-xin,TANG Wei.Ensembling neuralnetworks:many could be better than all [J].Artificial intelligence,2002,137(1):239-263.
[12] HAO Hong-wei,WANG Zhi-bin,YIN Xu-cheng,et al.Dynamic selection and circulating combination for multipleclassifier systems[J].Acta Automatica Sinica,2011,7(11):1290-1295.(in Chinese) 郝红卫,王志彬,殷绪成,等,分类器的动态选择与循环集成方法[J].自动化学报,2011,7(11):1290-1295.
[13] CAI Deng,ZHANG Chi-yuan,HE Xiao-fei.Unsupervised fea-ture selection for multi-cluster data[C]∥Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.ACM,2010:333-342.
[14] ZOU Quan,LI Xu-bin,JIANG Wen-rui,et al.Survey of MapReduce Frame Operation in Bioinformatics[J].Briefings in Bioinformatics,2014,5(4):637-647.
[15] ZOU Quan,GUO Jia-sheng,JU Ying,et al.Improving tR-NAscan-SE annotation results via ensemble classifiers [J].Molecular Informatics,2015,4(11/12):761-770.
[16] YANG Chun,YIN Xu-cheng,HAO Hong-wei.Classifier En-semble with Diversity:Effectiveness Analysis and Ensemble Optimization [J].Acta Automatica Sinica,2014,40(4):660-674.(in Chinese) 杨春,殷绪成,郝红卫,基于差异性的分类器集成:有效性分析及优化集成[J].自动化学报,2014,0(4):660-674.
[17] LIN Chen,ZOU Ying,QIN Ji,et al.Hierarchical Classification of Protein Folds Using a Novel Ensemble Classifier [J].PLoS One,2013,8(2):e56499 .
[18] MOSHE L.UCI machine learning repository .http://archive.ics.uci.edu/ml.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75, 88 .
[2] XIA Qing-xun and ZHUANG Yi. Remote Attestation Mechanism Based on Locality Principle[J]. Computer Science, 2018, 45(4): 148 -151, 162 .
[3] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[4] WANG Huan, ZHANG Yun-feng and ZHANG Yan. Rapid Decision Method for Repairing Sequence Based on CFDs[J]. Computer Science, 2018, 45(3): 311 -316 .
[5] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[6] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[7] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[8] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics[J]. Computer Science, 2018, 45(4): 169 -172 .
[9] ZHONG Fei and YANG Bin. License Plate Detection Based on Principal Component Analysis Network[J]. Computer Science, 2018, 45(3): 268 -273 .
[10] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99, 116 .