Computer Science ›› 2016, Vol. 43 ›› Issue (10): 266-271.doi: 10.11896/j.issn.1002-137X.2016.10.050

Previous Articles     Next Articles

Selective Ensemble Learning Algorithm of Extreme Learning Machine Based on Ant Colony Optimization

YANG Ju, YUAN Yu-long and YU Hua-long   

  • Online:2018-12-01 Published:2018-12-01

Abstract: This paper proposed a novel selective ensemble learning algorithm of extreme learning machine (ELM) based on the idea of ant colony optimization.The algorithm can overcome the drawbacks of the existing ensemble learning algorithms of ELM,such as low classification accuracy and generalization ability.Firstly,the proposed algorithm gene-rates lots of ELM classifiers by the strategy of randomly assigning input weights and biases of the hidden layer.It then uses a binary ant colony optimization algorithm to search the optimal combination of ELMs.At last,it uses the extracted combination of classifiers to classify test instances.The experimental results on 12 baseline data sets show that the proposed algorithm has acquired the best performance on nine data sets and the second best performance on the three remaining data sets.Adopting the proposed algorithm can obviously help to improve the classification accuracy and gene-ralization ability.

Key words: Extreme learning machine,Ant colony optimization,Ensemble learning,Selective ensemble

[1] Huang G B,Zhu Q Y,Siew C K.Extreme learning machine:theo-ry and applications[J].Neurocomputing,2006,70(1-3):489-501
[2] Rumelhart D E,Hinton G E,Williams R J.Learning representations by back-propagation errors[J].Nature,1986,323(9):533-536
[3] Huang G B,Wang D H,Lan Y.Extreme learning machine:a survey[J].International Journal of Machine Learning and Cybernetics,2011,2(2):107-122
[4] Wu Jun,Wang Shi-tong,Zhao Xin.Positive and negative fuzzyrule system,extreme learning machine and image classification[J].Journal of Image and Graphics,2011,11(8):1408-1417(in Chinese) 吴军,王士同,赵鑫.正负模糊规则系统、极限学习机与图像分类[J].中国图像图形学报,2011,11(8):1408-1417
[5] Minhas R,Baradarani A,Seifzadeh S,et al.Human action recognition using extreme learning machine based on visual vocabularies[J].Neurocomputing,2010,73(10-12):1906-1917
[6] Sun Z L,Choi T M,Au K F,et al.Sales forecasting using extreme learning machine with applications in fashion retailing[J].Decision Support Systems,2008,46(1):411-419
[7] Yan Qi-sheng,Wang Shi-tong,Zhang Yan-fei,et al.Uranium re-source price based on empirical mode decomposition and extreme learning machine[J].Control and Decision,2014,29(7):1187-1192(in Chinese) 颜七笙,王士同,张延飞,等.基于经验模式分解和极限学习机的铀资源价格预测方法[J].控制与决策,2014,29(7):1187-1192
[8] Li L N,Ouyang J H,Chen H L,et al.A Computer Aided Diagnosis System for Thyroid Disease Using Extreme Learning Machine[J].Journal of Medical Systems,2012,36(5):3327-3337
[9] Zhang R,Huang G B,Sundararajan N,et al.Multicategory Classification Using an Extreme Learning Machine for Microarray Gene Expression Cancer Diagnosis [J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2007,4(3):485-495
[10] Lu Hui-juan,An Chun-lin,Ma Xiao-ping,et al.Disagreementmeasure based ensemble of extreme learning machine for gene expression data classification[J].Chinese Journal of Compu-ters,2013,36(2):341-348(in Chinese) 陆慧娟,安春霖,马小平,等.基于输出不一致测度的极限学习机集成的基因表达数据分类[J].计算机学报,2013,36(2):341-348
[11] Lan Y,Soh Y C,Huang G B.Ensemble of online sequential extreme learning machine[J].Neurocomputing,2009,72(13):3391-3395
[12] Liu N,Wang H.Ensemble based extreme learning machine[J].IEEE Signal Processing Letters,2010,17(8):754-757
[13] Breiman L.Bagging Predictors[J].Machine Learning,1996,24(2):123-140
[14] Zhou Z H,Wu J X,Tang W.Ensembling neural networks:Many could be better than all[J].Artificial Intelligence,2002,137(1/2):239-263
[15] Colorni A,Dorigo M,Maniezzo V.Distributed optimization by ant colonies[C]∥Proceedings of the 1st European Conference on Artificial Life,1991.Paris,France,Cambridge,MA:MIT Press,1991:134-142
[16] Yu H L,Gu G C,Liu H B,et al.A modified ant colony optimization algorithm for tumor marker gene selection[J].Genomics,Proteomics & Bioinformatics,2009,7(4):200-208
[17] Yu H L,Ni J,Zhao J.ACOSampling:an ant colony optimization-based undersampling method for classifying imbalanced DNA microarray data[J].Neurocomputing,2013,101(3):309-318
[18] Alcala-Fdez J,Fernandez A,Luengo J,et al.KEEL data-mining software tool:Data set repository,integration of algorithms and experimental analysis framework[J].Journal of Multiple-Valued Logic and Soft Computing,2011,17(2/3):255-287
[19] Demsar J.Statistical comparisons of classifiers over multiple data sets[J].Journal of Machine Learning Research,2006,7(1):1-30
[20] Garcia S,Fernandez A,Luengo J,et al.Advanced non-parametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining:experimental analysis of power[J].Information Sciences,2010,180(10):2044-2064
[21] Garcia S,Herrera F.An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons[J].Journal of Machine Learning Research,2008,9(12):2677-2694

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!