Computer Science ›› 2014, Vol. 41 ›› Issue (2): 127-130.

Previous Articles     Next Articles

Parallel Primal Estimated Sub-GrAdient Solver for Structural SVM

GUO Li-na,YANG Ming and TU Jin-jin   

  • Online:2018-11-14 Published:2018-11-14

Abstract: Primal estimated sub-GrAdient solver for SVM (Pegasos) is a simple and effective iterative algorithm for solving the optimization problem of Support Vector Machine.The method alternates between stochastic gradient descent steps and projection steps to find a hyper-plane that can separate two classes of samples with the maximal margin.But it neglects the data distributions which are also vital for an optimal classifier.We developed a novel algorithm,termed as Parallel Primal Estimated sub-GrAdient Solver for Structural SVM (PSPegasos) by embedding the structural information into the SVM and using the parallel computing framework:MapReduce.This algorithm can take full advantage of the computing and storage capacity of the computer cluster,and be applicable to the optimization problem of the massive data.The algorithm was used to two NASA software module datasets CM1and PC1,and the experimental results show that the algorithm can accelerate the convergence speed,improve the classification performance and be an effective solution to the optimization problem of the massive data.

Key words: Structural support vector machine,Parallel,MapReduce

[1] Cortes C,Vapnik V.Support vector networks[J].MachineLearning,1995,20(2):273-295
[2] Collobert R,Bengio S,Bengio Y.A Parallel Mixture of SVMsfor Very Large Scale Problems[J].Neural computation,2002,14(5):1105-1114
[3] Graf H P,Cosatto E,Bottou L,et al.Parallel Support VectorMachines[C]∥The Cascade SVM:Proceedings of the Eighteenth Annual Conference on Neural Information Processing Systems,2005.Vancouver,Canada:MIT Press,2005:521-528 (下转第135页)(上接第130页)
[4] Dean J,Ghemawat S.MapReduce:simplified data processing onlarge clusters[J].Communications of the ACM,2008,51(1):107-113
[5] Chang E Y.Foundations of Large-Scale Multimedia Information Management and Retrieval[M].Berlin,Heidelberg:Springer,2011:213-230
[6] Zhao J,Liang Z,Yang Y.Parallelized incremental support vector machines based on MapReduce and Bagging technique[C]∥Proceedings of the International Conference on Information Science and Technology,2012.New York:IEEE,2012:297-301
[7] Zhao Z.Parallel Pegasos for Mahout.http://wenku.baidu.com/view/0e8d6d639b6648d7c1c74661.html,2012
[8] Lanckriet G R,Ghaoui L E,Bhattacharyya C,et al.A RobustMinimax Approach to Classification[J].Journal of Machine Learning Research,2002,3(3):555-582
[9] Huang K,Yang H,King I,et al.Learning large margin classi-fiers locally and globally[C]∥Proceedings of the twenty-first international conference on Machine learning,2004.New York:ACM,2004:51
[10] Yeung D S,Wang D,Ng W W,et al.Structured Large Margin Machines:Sensitive to Data Distributions[J].Machine Lear-ning,2007,68:171-200
[11] Xue H,Chen S,Yang Q.Structural support vector machine[C]∥Proceedings of the fifth International Symposium on Neural Networks,2008.Berlin,Heidelberg:Springer,2008:501-511
[12] Shalev-Shwartz S,Singer Y,Srebro N.Pegasos:Primal Esti-mated sub-GrAdient SOlver for SVM[C]∥Proceedings of the 24th International Conference on Machine Learning,2007.New York:ACM,2007:807-814

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!