Computer Science ›› 2024, Vol. 51 ›› Issue (8): 333-344.doi: 10.11896/jsjkx.230500046

• Artificial Intelligence • Previous Articles     Next Articles

Dynamic Multi-objective Optimization Algorithm Based on RNN Information Accumulation

CHENG Xuefeng1, DONG Minggang1,2   

  1. 1 School of Information Science and Engineering,Guilin University of Technology,Guilin,Guangxi 541006,China
    2 Guangxi Key Laboratory of Embedded Technology and Intelligent System,Guilin,Guangxi 541006,China
  • Received:2023-05-08 Revised:2023-10-13 Online:2024-08-15 Published:2024-08-13
  • About author:CHENG Xuefeng,born in 1996,postgraduate.His main research interest is dynamic multi-objective optimization algorithm based on evolutionary computing.
    DONG Minggang,born in 1977,Ph.D.His main research interests include intelligent computing,multi-objective optimization and machine learning.
  • Supported by:
    National Natural Science Foundation of China(61563012).

Abstract: Dynamic multi-objective optimization problems exist widely in real life.After the environment changes,it is necessary for the evolutionary algorithm to have the abilities of fast convergence,fast tracking Pareto optimal frontier and maintaining diversity.For severe and frequent environmental changes,the traditional forecasting method can not effectively obtain Pareto optimal frontier solution.For this problem,a dynamic multi-objective optimization algorithm based on recurrent neural networks information accumulation(IA-RNN) is proposed.Firstly,a nonlinear prediction method based on RNN information accumulation is proposed,which uses RNN recursion for information accumulation,improves the utilization rate of historical information and enhances the ability of prediction.Secondly,a linear prediction method based on individual is designed,which uses parameter matrix to predict the linear changes of individual.Linear prediction and RNN nonlinear prediction co-evolve,which can quickly track the Pareto optimal frontier.Finally,a parameter correction strategy based on the least square method is designed to guide the parameter correction by the approximate Pareto optimal frontier solution in the current environment,which reduces the influence of error accumulation.IA-RNN is compared with five representative dynamic multi-objective optimization algorithms on 14 DF benchmark problems.Experiments show that the IA-RNN algorithm has better convergence and diversity.

Key words: Dynamic multi-objective, Evolutionary algorithm, Forecast, Recurrent neural networks, Information accumulation

CLC Number: 

  • TP301
[1]WANG D J,LIU F,JIN Y.A multi-objective evolutionary algorithm guided by directed search for dynamic scheduling[J].Computers & Operations Research,2017,79:279-290.
[2]GUO Y N,CHENG J,LUO S,et al.Robust dynamic multi-objective vehicle routing optimization method[J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2017,15(6):1891-1903.
[3]MASHWANI W K,SALHI A.Multiobjective evolutionary algorithm based on multimethod with dynamic resources allocation[J].Applied Soft Computing,2016,39:292-309.
[4]QIAO J,ZHANG W.Dynamic multi-objective optimization control for wastewater treatment process[J].Neural Computing and Applications,2018,29:1261-1271.
[5]HUANG L,SUH I H,ABRAHAM A.Dynamic multi-objective optimization basedon membrane computing for control of time-varying unstable plants[J].Information Sciences,2011,181(11):2370-2391.
[6]DED K,RAO N U B,KARTHIK S.Dynamic multi-objective optimization and decision-making using modified NSGA-II:A case study on hydro-thermal power scheduling[C]//4th International Conference Evolutionary Multi-Criterion Optimization(EMO 2007).Matsushima,Japan:Springer Berlin Heidelberg,2007:803-817.
[7]JIANG S,YANG S.A steady-state and generational evolutio-nary algorithm for dynamic multiobjective optimization[J].IEEE Transactions on Evolutionary Computation,2016,21(1):65-82.
[8]ZHANG K,SHEN C,LIU X,et al.Multiobjective evolutionstrategy for dynamic multiobjective optimization[J].IEEE Transactions on Evolutionary Computation,2020,24(5):974-988.
[9]PENG Z,ZHENG J,ZOU J,et al.Novel prediction and memory strategies for dynamic multiobjective optimization[J].Soft Computing,2015,19:2633-2653.
[10]LIANG Z,ZHENG S,ZHU Z,et al.Hybrid of memory and prediction strategies for dynamic multiobjective optimization[J].Information Sciences,2019,485:200-218.
[11]ZHOU A,JIN Y,ZHANG Q.A population prediction strategy for evolutionary dynamic multiobjective optimization[J].IEEE Transactions on Cybernetics,2013,44(1):40-53.
[12]LI Q,ZOU J,YANG S,et al.A predictive strategy based on special points for evolutionary dynamic multi-objective optimization[J].Soft Computing,2019,23:3723-3739.
[13]LIANG Z P,LI H C,WANG Z Q,et al.Dynamic multi-objective evolutionary algorithm with adaptive change response [J].Acta Automatica Sinica,2023,49(8):1688-1706.
[14]SUN H,CAO A,HU Z,et al.A novelquantile-guided dual prediction strategies for dynamic multi-objective optimization[J].Information Sciences,2021,579:751-775.
[15]ZHANG H,DING J,JIANG M,et al.Inverse gaussian process modeling for evolutionary dynamic multiobjective optimization[J].IEEE Transactions on Cybernetics,2021,52(10):11240-11253.
[16]LIU R,CHEN Y,MA W,et al.A novel cooperative coevolu-tionary dynamic multi-objective optimization algorithm using a new predictive model[J].Soft Computing,2014,18:1913-1929.
[17]MA X,YANG J,SUN H,et al.Multiregional co-evolutionary algorithm for dynamic multiobjective optimization[J].Information Sciences,2021,545:1-24.
[18]JIANG M,HUNAG Z,QIU L,et al.Transfer learning-based dynamic multiobjective optimization algorithms[J].IEEE Transactions on Evolutionary Computation,2017,22(4):501-514.
[19]ELMAN J L.Finding structure in time[J].Cognitive Science,1990,14(2):179-211.
[20]RAMBABU R,VADAKKEPAT P,TAN K C,et al.A mixture-of-experts prediction framework for evolutionary dynamic multiobjective optimization[J].IEEE Transactions on Cybernetics,2019,50(12):5099-5112.
[21]DEB K,PRATAP A,AGARWAL S,et al.A fast and elitistmultiobjective genetic algorithm:NSGA-II[J].IEEE Transactions on Evolutionary Computation,2002,6(2):182-197.
[22]GONG X,ZHANG T,CHEN C L P,et al.Research review for broad learning system:Algorithms,theory,and applications[J].IEEE Transactions on Cybernetics,2022,52:8922-8950.
[23]WANG H,SONG G.Innovative NARX recurrent neural net-work model for ultra-thin shape memory alloy wire[J].Neurocomputing,2014,134:289-295.
[24]MA X M,YANG J M,SUN H,et al.Dynamic multi-objective optimization algorithm based on multi-region center point prediction [J].Control and Decision,2022,37(10):2477-2486.
[25]LI Z,TANAKA G.Multi-reservoir echo state networks with sequence resampling for nonlinear time-series prediction[J].Neurocomputing,2022,467:115-129.
[26]JIANG S,YANG S,YAO X,et al.Benchmark Functions for the CEC′2018Competition on Dynamic Multiobjective Optimization[R].Newcastle University,2018.
[27]ZHAO Q,YAN B,SHI Y,et al.Evolutionary dynamic multiobjective optimization via learning from historical search process[J].IEEE Transactions on Cybernetics,2021,52(7):6119-6130.
[28]ZHOU A,JIN Y,ZHANG Q.A population prediction strategy for evolutionary dynamic multiobjective optimization[J].IEEE Transactions on Cybernetics,2013,44(1):40-53.
[29]SIERRA M R,COELLO C A.Improving PSO-based multi-objective optimization using crowding,mutation and∈-dominance [C]//Evolutionary Multi-Criterion Optimization:Third International Conference(EMO 2005).Berlin Heidelberg:Springer,2005:505-519.
[30]WILCOXON F.Individual comparisons by ranking methods[M].New York:Springer,1992:196-202.
[31]TIAN Y,CHENG R,ZHANG X,et al.PlatEMO:A MATLAB platform for evolutionary multi-objective optimization[educational forum][J].IEEE Computational Intelligence Magazine,2017,12(4):73-87.
[32]FRIEDMAN M.The use of ranks to avoid the assumption ofnormality implicit in the analysis of variance[J].Journal of the American Statistical Association,1937,32(200):675-701.
[1] HAN Lijun, WANG Peng, LI Ruixu, LIU Zhongyao. Dual Direction Vectors-based Large-scale Multi-objective Evolutionary Algorithm [J]. Computer Science, 2024, 51(6A): 230700155-11.
[2] ZHAO Ziqi, YANG Bin, ZHANG Yuanguang. Hierarchical Traffic Flow Prediction Model Based on Graph Autoencoder and GRU Network [J]. Computer Science, 2024, 51(6A): 230400148-6.
[3] ZHAI Yunkai, QIAO Zhengwen, QIAO Yan. Forecasting Teleconsultation Demand Based on LSTM and Attention Mechanism [J]. Computer Science, 2024, 51(6A): 230800119-7.
[4] ZHANG Jianliang, LI Yang, ZHU Qingshan, XUE Hongling, MA Junwei, ZHANG Lixia, BI Sheng. Substation Equipment Malfunction Alarm Algorithm Based on Dual-domain Sparse Transformer [J]. Computer Science, 2024, 51(5): 62-69.
[5] ZHAO Miao, XIE Liang, LIN Wenjing, XU Haijiao. Deep Reinforcement Learning Portfolio Model Based on Dynamic Selectors [J]. Computer Science, 2024, 51(4): 344-352.
[6] YUAN Rong, PENG Lilan, LI Tianrui, LI Chongshou. Traffic Flow Prediction Model Based on Dual Prior-adaptive Graph Neural ODE Network [J]. Computer Science, 2024, 51(4): 151-157.
[7] CHEN Runhuan, DAI Hua, ZHENG Guineng, LI Hui , YANG Geng. Urban Electricity Load Forecasting Method Based on Discrepancy Compensation and Short-termSampling Contrastive Loss [J]. Computer Science, 2024, 51(4): 158-164.
[8] GAO Mengqi, FENG Xiang, YU Huiqun, WANG Mengling. Large-scale Multi-objective Evolutionary Algorithm Based on Online Learning of Sparse Features [J]. Computer Science, 2024, 51(3): 56-62.
[9] HUANG Kun, SUN Weiwei. Traffic Speed Forecasting Algorithm Based on Missing Data [J]. Computer Science, 2024, 51(3): 72-80.
[10] XU Haiyang, LIU Hailong, YANG Chaoyun, WANG Shuo, LI Zhanhuai. MMOS:Memory Resource Sharing Methods to Support Overselling in Multi-tenant Databases [J]. Computer Science, 2024, 51(2): 27-35.
[11] GENG Huantong, SONG Feifei, ZHOU Zhengli, XU Xiaohan. Improved NSGA-III Based on Kriging Model for Expensive Many-objective Optimization Problems [J]. Computer Science, 2023, 50(7): 194-206.
[12] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
[13] LIU Jiansong, KANG Yan, LI Hao, WANG Tao, WANG Hailing. Spatial-Temporal Graph-CoordAttention Network for Traffic Forecasting [J]. Computer Science, 2023, 50(6A): 220200042-7.
[14] MENG Xiangfu, XU Ruihang. City Traffic Flow Prediction Method Based on Dynamic Spatio-Temporal Neural Network [J]. Computer Science, 2023, 50(6A): 220600266-7.
[15] YIN Heng, ZHANG Fan, LI Tianrui. Short-time Traffic Flow Forecasting Based on Multi-adjacent Graph and Multi-head Attention Mechanism [J]. Computer Science, 2023, 50(4): 40-46.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!