基于蚁群优化的极限学习机选择性集成学习算法

doi:10.11896/j.issn.1002-137X.2016.10.050

计算机科学 ›› 2016, Vol. 43 ›› Issue (10): 266-271.doi: 10.11896/j.issn.1002-137X.2016.10.050

基于蚁群优化的极限学习机选择性集成学习算法

杨菊,袁玉龙,于化龙

江苏科技大学计算机科学与工程学院镇江212003,江苏科技大学计算机科学与工程学院镇江212003,江苏科技大学计算机科学与工程学院镇江212003

出版日期:2018-12-01 发布日期:2018-12-01
基金资助:
本文受国家自然科学基金(61305058),江苏省自然科学基金(BK20130471),中国博士后特别资助

Selective Ensemble Learning Algorithm of Extreme Learning Machine Based on Ant Colony Optimization

YANG Ju, YUAN Yu-long and YU Hua-long

Online:2018-12-01 Published:2018-12-01

摘要/Abstract

摘要： 针对现有极限学习机集成学习算法分类精度低、泛化能力差等缺点,提出了一种基于蚁群优化思想的极限学习机选择性集成学习算法。该算法首先通过随机分配隐层输入权重和偏置的方法生成大量差异的极限学习机分类器,然后利用一个二叉蚁群优化搜索算法迭代地搜寻最优分类器组合,最终使用该组合分类测试样本。通过12个标准数据集对该算法进行了测试,该算法在9个数据集上获得了最优结果,在另3个数据集上获得了次优结果。采用该算法可显著提高分类精度与泛化性能。

关键词: 极限学习机,蚁群优化,集成学习,选择性集成

Abstract: This paper proposed a novel selective ensemble learning algorithm of extreme learning machine (ELM) based on the idea of ant colony optimization.The algorithm can overcome the drawbacks of the existing ensemble learning algorithms of ELM,such as low classification accuracy and generalization ability.Firstly,the proposed algorithm gene-rates lots of ELM classifiers by the strategy of randomly assigning input weights and biases of the hidden layer.It then uses a binary ant colony optimization algorithm to search the optimal combination of ELMs.At last,it uses the extracted combination of classifiers to classify test instances.The experimental results on 12 baseline data sets show that the proposed algorithm has acquired the best performance on nine data sets and the second best performance on the three remaining data sets.Adopting the proposed algorithm can obviously help to improve the classification accuracy and gene-ralization ability.

Key words: Extreme learning machine,Ant colony optimization,Ensemble learning,Selective ensemble

杨菊,袁玉龙,于化龙. 基于蚁群优化的极限学习机选择性集成学习算法[J]. 计算机科学, 2016, 43(10): 266-271. https://doi.org/10.11896/j.issn.1002-137X.2016.10.050

YANG Ju, YUAN Yu-long and YU Hua-long. Selective Ensemble Learning Algorithm of Extreme Learning Machine Based on Ant Colony Optimization[J]. Computer Science, 2016, 43(10): 266-271. https://doi.org/10.11896/j.issn.1002-137X.2016.10.050

参考文献

[1] Huang G B,Zhu Q Y,Siew C K.Extreme learning machine:theo-ry and applications[J].Neurocomputing,2006,70(1-3):489-501
[2] Rumelhart D E,Hinton G E,Williams R J.Learning representations by back-propagation errors[J].Nature,1986,323(9):533-536
[3] Huang G B,Wang D H,Lan Y.Extreme learning machine:a survey[J].International Journal of Machine Learning and Cybernetics,2011,2(2):107-122
[4] Wu Jun,Wang Shi-tong,Zhao Xin.Positive and negative fuzzyrule system,extreme learning machine and image classification[J].Journal of Image and Graphics,2011,11(8):1408-1417(in Chinese) 吴军,王士同,赵鑫.正负模糊规则系统、极限学习机与图像分类[J].中国图像图形学报,2011,11(8):1408-1417
[5] Minhas R,Baradarani A,Seifzadeh S,et al.Human action recognition using extreme learning machine based on visual vocabularies[J].Neurocomputing,2010,73(10-12):1906-1917
[6] Sun Z L,Choi T M,Au K F,et al.Sales forecasting using extreme learning machine with applications in fashion retailing[J].Decision Support Systems,2008,46(1):411-419
[7] Yan Qi-sheng,Wang Shi-tong,Zhang Yan-fei,et al.Uranium re-source price based on empirical mode decomposition and extreme learning machine[J].Control and Decision,2014,29(7):1187-1192(in Chinese) 颜七笙,王士同,张延飞,等.基于经验模式分解和极限学习机的铀资源价格预测方法[J].控制与决策,2014,29(7):1187-1192
[8] Li L N,Ouyang J H,Chen H L,et al.A Computer Aided Diagnosis System for Thyroid Disease Using Extreme Learning Machine[J].Journal of Medical Systems,2012,36(5):3327-3337
[9] Zhang R,Huang G B,Sundararajan N,et al.Multicategory Classification Using an Extreme Learning Machine for Microarray Gene Expression Cancer Diagnosis [J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2007,4(3):485-495
[10] Lu Hui-juan,An Chun-lin,Ma Xiao-ping,et al.Disagreementmeasure based ensemble of extreme learning machine for gene expression data classification[J].Chinese Journal of Compu-ters,2013,36(2):341-348(in Chinese) 陆慧娟,安春霖,马小平,等.基于输出不一致测度的极限学习机集成的基因表达数据分类[J].计算机学报,2013,36(2):341-348
[11] Lan Y,Soh Y C,Huang G B.Ensemble of online sequential extreme learning machine[J].Neurocomputing,2009,72(13):3391-3395
[12] Liu N,Wang H.Ensemble based extreme learning machine[J].IEEE Signal Processing Letters,2010,17(8):754-757
[13] Breiman L.Bagging Predictors[J].Machine Learning,1996,24(2):123-140
[14] Zhou Z H,Wu J X,Tang W.Ensembling neural networks:Many could be better than all[J].Artificial Intelligence,2002,137(1/2):239-263
[15] Colorni A,Dorigo M,Maniezzo V.Distributed optimization by ant colonies[C]∥Proceedings of the 1st European Conference on Artificial Life,1991.Paris,France,Cambridge,MA:MIT Press,1991:134-142
[16] Yu H L,Gu G C,Liu H B,et al.A modified ant colony optimization algorithm for tumor marker gene selection[J].Genomics,Proteomics & Bioinformatics,2009,7(4):200-208
[17] Yu H L,Ni J,Zhao J.ACOSampling:an ant colony optimization-based undersampling method for classifying imbalanced DNA microarray data[J].Neurocomputing,2013,101(3):309-318
[18] Alcala-Fdez J,Fernandez A,Luengo J,et al.KEEL data-mining software tool:Data set repository,integration of algorithms and experimental analysis framework[J].Journal of Multiple-Valued Logic and Soft Computing,2011,17(2/3):255-287
[19] Demsar J.Statistical comparisons of classifiers over multiple data sets[J].Journal of Machine Learning Research,2006,7(1):1-30
[20] Garcia S,Fernandez A,Luengo J,et al.Advanced non-parametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining:experimental analysis of power[J].Information Sciences,2010,180(10):2044-2064
[21] Garcia S,Herrera F.An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons[J].Journal of Machine Learning Research,2008,9(12):2677-2694

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

基于蚁群优化的极限学习机选择性集成学习算法

Selective Ensemble Learning Algorithm of Extreme Learning Machine Based on Ant Colony Optimization

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

Metrics

本文评价

推荐阅读 0