Computer Science ›› 2025, Vol. 52 ›› Issue (6A): 240600096-6.doi: 10.11896/jsjkx.240600096

• Artificial Intelligence • Previous Articles     Next Articles

Adaptive Hybrid Genetic Algorithm Based on PPO for Solving Traveling Salesman Problem

HUANG Ao1, LI Min1, ZENG Xiangguang1, PAN Yunwei1, ZHANG Jiaheng1, PENG Bei2   

  1. 1 School of Mechanical Engineering,Southwest Jiaotong University,Chengdu 610031,China
    2 School of Mechanical and Electrical Engineering,University of Electronic Science and Technology of China,Chengdu 611731,China
  • Online:2025-06-16 Published:2025-06-12
  • About author:HUANG Ao,born in 1999,postgraduate,is a member of CCF(No.U4934G).His main research interests include AUVs path planning and so on.
    LI Min,born in 1981,Ph.D,lecturer.His main research interests include machine learning and intelligent control.
  • Supported by:
    Key R&D Program Poject of Sichuan Provincial Department of Science and Technology(2023YFG0285).

Abstract: Traveling salesman problem(TSP) is a classic combinatorial optimization problem known for its significant computational complexity.Traditional genetic algorithms heavily rely on empirical parameter adjustments when solving the TSP,and premature reduction of population diversity will lead to local convergence,severely impacting algorithm performance.Therefore,this paper proposes an adaptive hybrid genetic algorithm(AHGA) that adjusts the key parameters of genetic algorithms adaptively with reinforcement learning.Firstly,an adaptive parameter adjustment model based on genetic algorithms is constructed.Proximal policy optimization(PPO) algorithm is employed to generate action policies controlling population evolution.Secondly,a hybrid operator is introduced to traditional genetic algorithm crossover and mutation to enhance population diversity in later iterations.Finally,the effectiveness and performance of the algorithm are validated on various TSPLIB public instances.The results demonstrate that the proposed algorithm significantly improves the solution quality and convergence speed of genetic algorithms,effectively avoiding local convergence issues,and outperforms similar algorithms in solving TSP.

Key words: Traveling salesman problem, Genetic algorithm, Proximal policy optimization, Hybrid operator, Parameter adaptation

CLC Number: 

  • TP181
[1]XU W H,WEI C X,ZHANG G R.Genetic Algorithm for Tra-veling Salesman Problem Based on K-Nearest Neighbors Search [J].Journal of Kunming University of Science and Technology(Natural Science),2022,47(1):139-146.
[2]LI C,WANG N,ZHANG C.Hierarchical Mission Planning for Cleaning Photovoltaic Panels Based on Improved Genetic Algorithm[J].Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University,2021,55(9):1169-74.
[3]WANG S,LIU G,GAO M,et al.Application of improved adaptive genetic algorithm in TDOA location[J].Journal of Systems Engineering and Electronics,2019,41(2):254-258.
[4]XU J,HAN F Q,LIU Q X,et al.Bioinformation Heuristic Genetic Algorithm for Solving TSP[J].Journal of System Simulation,2022,34(8):1811-1819.
[5]CHEN R,YANG B,LI S,et al.A self-learning genetic algorithm based on reinforcement learning for flexible job-shop scheduling problem [J].Computers and Industrial Engineering,2020,149:106778.
[6]KOKSAL AHMED E,LI Z,VEERAVALLI B,et al.Reinforcement learning-enabled genetic algorithm for school bus scheduling [J].Journal of Intelligent Transportation Systems:Technology,Planning,and Operations,2022,26(3):269-83.
[7]SONG Y,WEI L,YANG Q,et al.RL-GA:A ReinforcementLearning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem [J].Swarm and Evolutionary Computation,2023,77.
[8]SHENMAIER V.Efficient PTAS for the maximum travelingsalesman problem in a metric space of fixed doubling dimension [J].Optimization Letters,2022,16(7):2115-2122.
[9]SCHULMAN J,WOKSKI F,DHARIWAL P,et al.Proximalpolicy optimization algorithms [J].arXiv:1707.06347,2017.
[10]QUEVEDO J,ABDELATTI M,IMANI F,et al.Using rein-forcement learning for tuning genetic algorithms [C]//EGCCO 2021.France:Association for Computing Machinery,2021.
[11]JIAN-TING C,YANG X.Survey of Unstable Gradients in Deep Neural Network Training [J].Journal of Software,2018,29(7):2071-91.
[12]ZENG D,YAN T,ZENG Z,et al.A Hyperparameter Adaptive Genetic Algorithm Based on DQN [J].Journal of Circuits,Systems and Computers,2023,32(4).
[13]DORIGO M,GAMBARDELLA L M.Ant colonies for the tra-velling salesman problem [J].Biosystems,1997,43(2):73-81.
[14]GLOVER F W.Tabu Search - Part I [J].INFORMS J Comput,1989,1:190-206.
[15]ZHANG C,TU L,WANG J.Application of self-adaptive antcolony optimization in TSP [J].Journal of Central South University(Science and Technology),2015,46:2944-2949.
[16]DAI H,KHALIL E B,ZHANG Y,et al.Learning combinatorial optimization algorithms over graphs [C]//Proceedings of the 31st International Conference on Neural Information Processing Systems.2017:6351-6361.
[17]WU Y,SONH W,CAO Z,et al.Learning Improvement Heuristics for Solving Routing Problems [J].IEEE Transactions on Neural Networks and Learning Systems,2022,33(9):5057-5069.
[18]GUNDUZ M,KIRAN M S,OZCEYLAN E.A hierarchic ap-proach based on swarm intelligence to solve the traveling salesman problem [J].Turkish Journal of Electrical Engineering and Computer Sciences,2015,23(1):103-117.
[1] ZHAI Xueyu, YANG Weizhong. Adaptive Differential Evolution Based on Self-guided Perturbation and Extreme DimensionExchange [J]. Computer Science, 2025, 52(6A): 240800100-14.
[2] KONG Chao, WANG Wei, HUANG Subin, ZHANG Yi, MENG Dan. Autonomous Obstacle Avoidance Method for Unmanned Surface Vehicles Based on ImprovedProximal Policy Optimization [J]. Computer Science, 2025, 52(4): 40-48.
[3] WANG Sitong, LIN Rongheng. Improved Genetic Algorithm with Tabu Search for Asynchronous Hybrid Flow Shop Scheduling [J]. Computer Science, 2025, 52(4): 271-279.
[4] YAN Xin, HUANG Zhiqiu, SHI Fan, XU Heng. Study on Following Car Model with Different Driving Styles Based on Proximal PolicyOptimization Algorithm [J]. Computer Science, 2024, 51(9): 223-232.
[5] WEI Niannian, HAN Shuguang. New Solution for Traveling Salesman Problem Based on Graph Convolution and AttentionNeural Network [J]. Computer Science, 2024, 51(6A): 230700222-8.
[6] XU Haitao, CHENG Haiyan, TONG Mingwen. Study on Genetic Algorithm of Course Scheduling Based on Deep Reinforcement Learning [J]. Computer Science, 2024, 51(6A): 230600062-8.
[7] HUANG Fei, LI Yongfu, GAO Yang, XIA Lei, LIAO Qinglong, DAI Jian, XIANG Hong. Scheduling Optimization Method for Household Electricity Consumption Based on Improved Genetic Algorithm [J]. Computer Science, 2024, 51(6A): 230600096-6.
[8] LI Zhibo, LI Qingbao, LAN Mingjing. Method of Generating Test Data by Genetic Algorithm Based on ART Optimal Selection Strategy [J]. Computer Science, 2024, 51(6): 95-103.
[9] WANG Baocai, WU Guowei. Feature-weighted Counterfactual Explanation Method:A Case Study in Credit Risk Control Scenarios [J]. Computer Science, 2024, 51(12): 259-268.
[10] XIE Guangqiang, WU Yebin, LI Yang. Motif Based Hybrid-order Network Consensus for Multi-agent Systems with Trade-off Parameter Adaptation [J]. Computer Science, 2024, 51(12): 269-276.
[11] HAN Huijian, LIU Kexin, LIN Xue. Air Quality Fuzzy Cognitive Map Forecasting Based on Niche Genetic Algorithm [J]. Computer Science, 2024, 51(11A): 240300120-6.
[12] JIANG Yibo, ZHOU Zebao, LI Qiang, ZHOU Ke. Optimization of Low-carbon Oriented Logistics Center Distribution Based on Genetic Algorithm [J]. Computer Science, 2024, 51(11A): 231200035-6.
[13] GU Chan, FU Yan, YE Shengli. Tourism Route Planning Based on Colored Traveling Salesman Problem [J]. Computer Science, 2024, 51(11A): 231200072-8.
[14] ZHONG Linhui, YANG Chaoyi, XIA Zihao, HUANG Qixuan, QU Qiaoqiao, LI Fangyun, SUN Wenbin. Style-oriented Software Architecture Evolution Path Generation Method [J]. Computer Science, 2024, 51(11A): 240100130-9.
[15] WANG Ziyang, WANG Jia, XIONG Mingliang, WANG Wentao. Intelligent Penetration Path Based on Improved PPO Algorithm [J]. Computer Science, 2024, 51(11A): 231200165-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!