Computer Science ›› 2017, Vol. 44 ›› Issue (1): 37-41.doi: 10.11896/j.issn.1002-137X.2017.01.007

Previous Articles     Next Articles

Online Sequential Active Learning Approach

ZHAI Jun-hai, ZANG Li-guang and ZHANG Su-fang   

  • Online:2018-11-13 Published:2018-11-13

Abstract: In the real world,there are a lot of unlabelled data,such as various medical images and web data,etc.In the era of big data,this situation is more prominent.It is expensive to label large amount of unlabelled data.Active learning is an effective method to solve this problem,and it is one of the hot research topics in the field of machine learning and data mining.Based on online sequential extreme learning machine,an active learning algorithm was proposed in this paper.Due to the nature of incremental learning embedded in online sequential extreme learning machine,the proposed algorithm can significantly improve the efficiency of learning system.Furthermore,the proposed algorithm uses instance entropy as heuristic to measure the importance of the unlabeled instances,and uses K-nearest neighbor classifier as Oracle to label the selected instances.The experimental results show that the proposed algorithm has fast learning speed with exact labeling.

Key words: Active learning,Extreme learning machine,Online sequential learning,Instance entropy,K-nearest neighbors

[1] ANGLUIN D.Queries and concept learning [J].Machine Lear-ning,1988,2(4):319-342.
[2] SEUNG H,OPPER M,SOMPOLINSKY H.Query by committee [C]∥Proceedings of the Fifth Annual Workshop on Computational Learning Theory.1992:287-294.
[3] LEWIS D,GAIL W.A sequential algorithm for training textclassifiers [C]∥Proceedings of the 17th ACM International Conference on Research and Development in Information Retrieval.Berlin:Springer,New York,1994:3-12.
[4] SCHOHN G,COHN D.Less is more:active learning with support vector machines [C]∥Proceedings 17th International Conference on Machine Learning.Morgan Kaufmann,San Francisco,CA,2000:839-846.
[5] WANG X Z,DONG L C,YAN J H.Maximum ambiguity based sample selection in fuzzy decision tree induction [J].IEEE Transactions on Knowledge and Data Engineering,2012,24(8):1491-1505.
[6] TONG S,KOLLER D.Support vector machine active learning with applications to text classification [J].The Journal of Machine Learning Research,2002,2:45-66.
[7] COHN D,ATLAS L,LADNER R.Improving generalizationwith active learning [J].Machine Learning,1994,15(2):201-221.
[8] WANG R,KWONG S,CHEN D G.Inconsistency-based active learning for support vector machines [J].Pattern Recognition,2012(45):3751-3767.
[9] LUGHOFER E.Hybrid active learning for reducing the annotation effort of operators in classification systems [J].Pattern Recognition,2012(45):884-896.
[10] WANG Z,YAN S H,ZHANG C S.Active learning with adaptive regularization [J].Pattern Recognition,2011,44(10/11):2375-2383.
[11] SUN S,HARDOON D R.Active learning with extremely sparse labeled examples [J].Neurocomputing,2010,73(16-18):2980-2988.
[12] HE Y B,GENG Z.Active Learning of Causal Networks with Intervention Experiments and Optimal Designs [J].Journal of Machine Learning Research,2008,9:2523-2547.
[13] HOI S C H,JIN R,LYU M R.Batch mode active learning with applications to text categorization and image retrieval [J].IEEE Transactions on Knowledge and Data Engineering,2009,21(9):1233-1248.
[14] TIAN Chun-na,GAO Xin-bo,LI Jie.An example selection me-thod for active learning based on embedded bootstrap algorithm [J].Journal of Computer Research and Development,2006,43(10):1706-1712.(in Chinese) 田春娜,高新波,李洁.基于嵌入式Bootstrap的主动学习示例选择方法 [J].计算机研究与发展,2006,43(10):1706-1712.
[15] GAO X B,SU Y,LI X L,et al.A review of active appearance models [J].IEEE Transaction on System,Man,and Cybernetics Part C:Applications and Reviews,2010,40(2):145-158.
[16] ZHANG C S,WANG F.A multilevel approach for learning from labeled and unlabeled data on graphs [J].Pattern Recognition,2010,43(6):2301-2315.
[17] YU H,SUN C,YANG W,et al.AL-ELM:One uncertainty-based active learning algorithm using extreme learning machine [J].Neurocomputing,2015,166:140-150.
[18] YONG Z,MENG J E.Sequential active learning using meta-cognitive extreme learning machine [J].Neurocomputing,2016,3:835-844.
[19] GU Y,JIN Z,CHIU S C.Active learning combining uncertainty and diversity for multi-class image classification [J].IET Computer Vision,2015,9(3):400-407.
[20] LONG B,BIAN J,CHAPELLE O,et al.Active learning forranking through expected loss optimization[J].IEEE Transactions on Knowledge and Data Engineering,2015,27(5):1180-1191.
[21] HUANG S J,JIN R,ZHOU Z H.Active Learning by Querying Informative and Representative Examples [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2014,36(10):1936-1949.
[22] HU L S,LU S X,WANG X Z.A new and informative active learning approach for support vector machine [J].Information Sciences,2013,244(7):142-160.
[23] HUANG G B,ZHU Q Y,SIEW C K.Extreme learning ma-chine:Theory and applications [J].Neurocomputing,2006,70(1-3):489-501.
[24] LIANG N Y,HUANG G B,SARATCHANDRAN P,et al.A fast and accurate on-line sequential learning algorithm for feedforward networks [J].IEEE Transactions on Neural Networks,2006,7(6):1411-1423.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!