Computer Science ›› 2026, Vol. 53 ›› Issue (4): 57-65.doi: 10.11896/jsjkx.251100083

• Interdisciplinary Integration of Artificial Intelligence and Theoretical Computer Science • Previous Articles     Next Articles

Research on Efficient Construction of Plateaued Functions Based on DQN-enhanced Genetic Algorithm

WU Yansheng, CAO Xinyi, FAN Weibei   

  1. College of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
  • Received:2025-11-17 Revised:2026-01-16 Online:2026-04-15 Published:2026-04-08
  • About author:WU Yansheng,born in 1989,postdoctoral,associate professor.His main research interests include coding theory and cryptographic functions.
  • Supported by:
    National Natural Science Foundation of China(62372247) and Jiangsu Province Postgraduate Research and Practice Innovation Program(SJCX24_0326).

Abstract: Plateaued functions,as an important generalization of Bent functions,inherit many of the desirable cryptographic pro-perties of Bent functions and hold significant application value.However,traditional methods for constructing plateaued functions suffer from issues such as high computational complexity and limited flexibility.To address these challenges,this paper proposes an adaptive genetic algorithm enhanced by a deep Q-Network(DQN).This algorithm deeply integrates DQN with the genetic algorithm,constructing a multi-dimensional state space to perceive population evolutionary characteristics.Through a group consensus mechanism,it intelligently selects from six combinations of crossover and mutation strategies,enabling adaptive control of genetic parameters.Experimental results demonstrate that the proposed algorithm achieves a fitness improvement of 0.20~0.35,exhibits faster convergence speed and higher stability,and can generate an average of 230~300 valid Plateaued function truth sequences,significantly outperforming both the standard genetic algorithm and the basic Q-learning-enhanced genetic algorithm.The algorithm intelligently adjusts the mutation rate within the range of 0.235~0.276 and maintains the crossover operation usage rate between 70% and 90%,effectively optimizing the Walsh spectrum distribution while preserving population diversity.Although computational overhead increases slightly,its significant advantages in solution quality,convergence performance,and strategic adaptability validate the effectiveness of deep reinforcement learning in the construction of cryptographic functions,providing a novel approach for the intelligent design of Boolean functions.

Key words: Plateaued function, Truth sequence, Q-learning, Deep Q-Network, Genetic algorithm, Walsh spectrum, Nonlinearity

CLC Number: 

  • TP181
[1]SHANNON C E.A mathematical theory of communication[J].The Bell System Technical Journal,1948,27(3):379-423.
[2]HAMMING R W.Error detecting and error correcting codes[J].The Bell System Technical Journal,1950,29(2):147-160.
[3]BOSE R C,RAY-CHAUDHURI D K.On a class of error correcting binary group codes[J].Information and Control,1960,3(1):68-79.
[4]MACWILLIAMS F J,SLOANE N J A.The theory of error-correcting codes[M].Elsevier,1977.
[5]CARLET C.Partially-bent functions[J].Designs,Codes andCryptography,1993,3(2):135-145.
[6]ZHENG Y,ZHANG X M.Plateaued functions[C]//International Conference on Information and Communications Security.Berlin,Springer,1999:284-300.
[7]HYUN J Y,LEE J,LEE Y.Explicit criteria for construction of plateaued functions[J].IEEE Transactions on Information Theo-ry,2016,62(12):7555-7565.
[8]STANKOVIĆ M,MORAGA C,STANKOVIĆ R.Construction of ternary plateaued functions from quadratic forms for ternary bent functions[C]//2021 IEEE 51st International Symposium on Multiple-Valued Logic(ISMVL).IEEE,2021:1-6.
[9]SUN T F,HU B,YANG Y.Research on the Construction ofPlateaued Functions[J].Journal of Electronics & Information Technology,2018,40(10):2352-2357.
[10]CHEN R,YANG B,LI S,et al.A self-learning genetic algorithm based on reinforcement learning for flexible job-shop scheduling problem[J].Computers & Industrial Engineering,2020,149:106778.
[11]CHENG L,TANG Q,ZHANG L,et al.Scheduling flexiblemanufacturing cell with no-idle flow-lines and job-shop via Q-learning-based genetic algorithm[J].Computers & Industrial Engineering,2022,169:108293.
[12]YANG Q.Research on Adaptive Scheduling of AutomatedWarehousing System Based on Q-learning[D].Hangzhou:Hangzhou Dianzi University,2025.
[13]MIRALLES-PECHUÁN L,JIMÉNEZ F,PONCE H,et al.A methodology based on deep q-learning/genetic algorithms for optimizing covid-19 pandemic government actions[C]//Procee-dings of the 29th ACM International Conference on Information &Knowledge Management.2020:1135-1144.
[14]KUKKER A,SHARMA R.A genetic algorithm assisted fuzzy Q-learning epileptic seizure classifier[J].Computers & Electrical Engineering,2021,92:107154.
[15]LIU F,ZENG G.Study of genetic algorithm with reinforcement learning to solve the TSP[J].Expert Systems with Applications,2009,36(3):6995-7001.
[16]ZHANG Z Y,WANG L,CAI J C,et al.Application research of improved Q-learning genetic algorithm in path planning[J].CAAI Transactions on Intelligent Systems,2025,20(6):1493-1504.
[17]ASTHANA R,VERMA N,RATAN R.Generation of Boolean functions using Genetic Algorithm for cryptographic applications[C]//2014 IEEE International Advance Computing Conference(IACC).IEEE,2014:1361-1366.
[18]CARLET C.On the confusion and diffusion properties of Maiorana-McFarland’s and extended Maiorana-McFarland’s functions[J].Journal of Complexity,2004,20(2/3):182-204.
[19]HODŽIĆ S,PASALIC E,WEI Y,et al.Designing plateauedBoolean functions in spectral domain and their classification[J].IEEE Transactions on Information Theory,2019,65(9):5865-5879.
[20]HODŽIĆ S,PASALIC E,WEI Y.A general framework for secondary constructions of bent and plateaued functions[J].Designs,Codes and Cryptography,2020,88(10):2007-2035.
[21]MARIOT L,LEPORATI A.A genetic algorithm for evolving plateaued cryptographic boolean functions[C]//International Conference on Theory and Practice of Natural Computing.Cham:Springer,2015:33-45.
[22]PICEK S,CARLET C,GUILLEY S,et al.Evolutionary algo-rithms for boolean functions in diverse domains of cryptography[J].Evolutionary Computation,2016,24(4):667-694.
[23]JEONG J,LEE Y.Algorithms for constructing balanced pla-teaued functions with maximal algebraic degrees[J].IEEE Transactions on Information Theory,2023,70(2):1408-1421.
[24]BEHERA P K,GANGOPADHYAY S.An improved hybrid genetic algorithm to construct balanced Boolean function with optimal cryptographic properties[J].Evolutionary Intelligence,2022,15(1):639-653.
[25]PICEK S,MARCHIORI E,BATINA L,et al.Combining evolutionary computation and algebraic constructions to find crypto-graphy-relevant boolean functions[C]//International Confe-rence on Parallel Problem Solving from Nature.Cham:Springer,2014:822-831.
[26]CLIFTON J,LABER E.Q-learning:Theory and applications[J].Annual Review of Statistics and Its Application,2020,7(1):279-301.
[27]FAN J,WANG Z,XIE Y,et al.A theoretical analysis of deep Q-learning[C]//Learning for Dynamics and Control.PMLR,2020:486-489.
[28]GU S,LILLICRAP T,SUTSKEVER I,et al.Continuous deep q-learning with model-based acceleration[C]//International Conference on Machine Learning.PMLR,2016:2829-2838.
[29]WU Y N,ZHANG J.An Improved NSGA-II Algorithm forBullet Distribution[J].Ship Electronic Engineering,2023,43(4):29-33.
[30]PANDA S K,LIU R,XIANG Y.Asymptotic Analysis of Sample-averaged Q-learning[J].IEEE Transactions on Information Theory,2025,71(7):5601-5619.
[31]HE K,CHEN C,CHEN S,et al.Reinforcement Learning for Multi-Objective Optimization:A Review[J/OL].Archives of Computational Methods in Engineering,2025:1-30.https://doi.org/10.1007/s11831-025-10389-3.
[32]MIRJALILI S.Evolutionary algorithms and neural networks[J].Studies in Computational Intelligence,2019,780(1):43-53.
[33]ZOJAJI Z,KAZEMI A.Adaptive reinforcement-based geneticalgorithm for combinatorial optimization[J].Journal of Computing and Security,2022,9(1):71-84.
[1] WEN Jia, WU Shuxia, YU Zhengxin, MIAO Wang, CHEN Zheyi. Multi-objective Optimization for Virtual Machine Placement in Large-scale Hadoop Cluster [J]. Computer Science, 2026, 53(2): 387-395.
[2] WANG Wei, ZHAO Yunlong, PENG Xiaoyu, PAN Xiaodong. TSK Fuzzy System Enhanced by TSVR with Cooperative Parameter Optimization [J]. Computer Science, 2025, 52(7): 75-81.
[3] WANG Xiang, HAN Qinghai, LIANG Jiarui, YU Xiaoli, WU Qi, QING Li. Research on Multi-user Task Offloading and Service Caching Strategies [J]. Computer Science, 2025, 52(7): 307-314.
[4] HUANG Ao, LI Min, ZENG Xiangguang, PAN Yunwei, ZHANG Jiaheng, PENG Bei. Adaptive Hybrid Genetic Algorithm Based on PPO for Solving Traveling Salesman Problem [J]. Computer Science, 2025, 52(6A): 240600096-6.
[5] WANG Sitong, LIN Rongheng. Improved Genetic Algorithm with Tabu Search for Asynchronous Hybrid Flow Shop Scheduling [J]. Computer Science, 2025, 52(4): 271-279.
[6] ZHAO Haixia, LI Xin, WEI Yongzhuang. Rank-sorting Hybrid Genetic Algorithm for Search High Quality Balanced Boolean Functions [J]. Computer Science, 2025, 52(12): 351-357.
[7] SONG Rirong, CHEN Qinwen, CHEN Xing. Distributed Automated Testing for Android Applications Based on Reinforcement Learning [J]. Computer Science, 2025, 52(12): 40-47.
[8] LI Xiaogeng, HAN Xiao, XIAO Haiyi. Cooperative Defense Method for Network Space Object of Power Monitoring System [J]. Computer Science, 2025, 52(11A): 241200158-7.
[9] LANG Aoqi, HUANG Weijie, YU Zhiyong, HUANG Fangwan. Spatiotemporal Active-sampling and Joint Inference of Urban Air Quality Data [J]. Computer Science, 2025, 52(11A): 241000116-9.
[10] YU Ping, YAN Hui, BAO Jie, GENG Xiaozhong. MEC Network Task Offloading and Migration Strategy Based on Optimization Model [J]. Computer Science, 2025, 52(11A): 241200215-6.
[11] ZHAO Yingnan, LENG Chongyang, HAN Qilong, YU Cheng. Adaptive Android Program Test Method Based on Thompson Sampling [J]. Computer Science, 2025, 52(11): 330-338.
[12] WANG Tianjiu, LIU Quan, WU Lan. Offline Reinforcement Learning Algorithm for Conservative Q-learning Based on Uncertainty Weight [J]. Computer Science, 2024, 51(9): 265-272.
[13] ZHONG Yuang, YUAN Weiwei, GUAN Donghai. Weighted Double Q-Learning Algorithm Based on Softmax [J]. Computer Science, 2024, 51(6A): 230600235-5.
[14] HUANG Fei, LI Yongfu, GAO Yang, XIA Lei, LIAO Qinglong, DAI Jian, XIANG Hong. Scheduling Optimization Method for Household Electricity Consumption Based on Improved Genetic Algorithm [J]. Computer Science, 2024, 51(6A): 230600096-6.
[15] XU Haitao, CHENG Haiyan, TONG Mingwen. Study on Genetic Algorithm of Course Scheduling Based on Deep Reinforcement Learning [J]. Computer Science, 2024, 51(6A): 230600062-8.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!