计算机科学 ›› 2026, Vol. 53 ›› Issue (9): 165-172.doi: 10.11896/jsjkx.250800029
丛伟杰1, 岳远艺2, 王敏2
CONG Weijie1, YUE Yuanyi2, WANG Min2
摘要: 最小闭包球(MEB)问题是机器学习和计算几何中一个经典的优化问题,其目标是寻找一个半径最小的球包围给定的数据点集。通过结合经典远离步与成对远离步两种远离步方向,提出一种改进的双远离步条件梯度(Double Away-step Conditional Gradient,DACG)算法,用于求解n维空间中m个数据点集的MEB。与其他结合远离步的双选条件梯度算法变体相比,DACG算法放弃选用原始条件梯度算法中的朝向步方向,在每次迭代中通过比较经典远离步与成对远离步方向下的目标函数精确增量进行选步。DACG算法求解MEB问题(1+∈)-近似解的线性多项式时间复杂度为O(mn/∈)。数值实验结果表明,DACG算法能显著提高求解高维大规模数据集MEB问题的计算效率。尤其是与经典的远离步条件梯度算法相比,DACG算法的迭代次数可减少31.8%~46.5%,运行时间可节省30.5%~54.5%。此外,在数值实验中将DACG算法扩展应用于机器学习中的支持向量数据描述,进一步验证了算法处理真实数据集的有效性。
中图分类号:
| [1] CONG W J,AN M Y,LI C Z.An Active-set Minimum Enclosing Ball Algorithm Based on Second-order Away-step[J].Journal of Xi'an University of Posts and Telecommunications,2024,29(3):83-89. [2] CAVALEIRO M,ALIZADEH F.A branch-and-bound method for the minimum k-enclosing ball problem[J].Operations Research Letters,2022,50(3):274-280. [3] CONG W J,LIU H W.Research on the Algorithm for the Minimum Enclosing Ball Problem Based on Active Set Strategy[J].Computer Science,2013,40(9):234-236,253. [4] DENG S Z,TENG D,LI X H,et al.Spherical Regularized Support Vector Description for Visual Anomaly Detection[J].Chinese Journal of Scientific Instrument,2024,45(3):315-325. [5] WU H N,XING H J,LI G.Deep Multiple-sphere Support Vector Data Description Based on Variational Autoencoder with Mixture-of-Gaussians Prior[J].Computer Science,2024,51(6):135-143. [6] GU X,WANG S T.Novel Domain Transfer Learning Approach Using Minimum Enclosing Ball[J].Computer Science,2013,40(7):187-192. [7] TSANG I W,KWOK J T,CHEUNG P.Core vector machines:Fast SVM training on very large data sets [J].Journal of Machine Learning Research,2005,6(4):363-392. [8] LEVITIN E S,POLYAK B T.Constrained minimization me-thods[J].USSR Computational Mathematics and Mathematical Physics,1966,6(5):787-823. [9] FRANK M,WOLFE P.An algorithm for quadratic program-ming[J].Naval Research Logistics Quarterly,1956,3(1/2):95-110. [10] WOLFE P.Convergence theory in nonlinear programming[M] //Integer and Nonlinear Programming.Amsterdam:North-Holland Publishing Company,1970:1-36. [11] YILDIRIM E A.Two algorithms for the minimum enclosing ball problem[J].SIAM Journal on Optimization,2008,19(3):1368-1391. [12] LACOSTE-JULIEN S,JAGGI M.On the Global Linear Convergence of Frank-Wolfe Optimization Variants[C] //Advances in Neural Information Processing Systems.Curran Associates,Inc.,2015. [13] CHEN P H,FAN R E,LIN C J.A study on SMO-type decomposition methods for support vector machines[J].IEEE Tran-sactions on Neural Networks,2006,17(4):893-908. [14] CONG W J,LIU H W.An SMO-type Method for Solving the MEB Problem[J].Journal of Northwest University(Natural Science Edition),2010,40(6):965-969. [15] CONG W J,LIU H W,YE F,et al.Rank-two update algorithms for the minimum volume enclosing ellipsoid problem[J].Computational Optimization and Applications,2012,51(1):241-257. [16] CONG W J,WANG L,SUN H.Rank-two update algorithm versus Frank-Wolfe algorithm with away steps for the weighted Euclidean one-center problem[J].Computational Optimization and Applications,2020,75(1):237-262. [17] ÑANCULEF R,FRANDI E,SARTORI C,et al.A novel Frank-Wolfe algorithm.Analysis and applications to large-scale SVM training[J].Information Sciences,2014,285(20):66-99. [18] TSUJI K,TANAKA K,POKUTTA S.Pairwise ConditionalGradients without Swap Steps and Sparser Kernel Herding[C] //International Conference on Machine Learning.PMLR,2022:21864-21883. |
|
||