Computer Science ›› 2024, Vol. 51 ›› Issue (2): 300-310.doi: 10.11896/jsjkx.230600128

• Computer Network • Previous Articles     Next Articles

Study on Cache-oriented Dynamic Collaborative Task Migration Technology

ZHAO Xiaoyan1,2, ZHAO Bin1, ZHANG Junna1,2, YUAN Peiyan1   

  1. 1 College of Computer and Information Engineering,Henan Normal University,Xinxiang,Henan 453007,China
    2 Engineering Lab of Intelligence Business&Internet of Things,Xinxiang,Henan 453007,China
  • Received:2023-06-15 Revised:2023-09-26 Online:2024-02-15 Published:2024-02-22
  • About author:ZHAO Xiaoyan,born in 1981,Ph.D,associate professor,is a member of CCF(No.K8282M).Her main research interests include mobile edge computing,D2D communication and Internet of things.ZHANG Junna,born in 1979,Ph.D,associate professor,is a member of CCF(No.D2234M).Her main research interests include mobile edge computing and services computing.
  • Supported by:
    National Natural Science Foundation of China (62072159,61902112) and Science and Technology Research Project of Henan Province(222102210011,232102211061).

Abstract: Task migration technology has been propelled by the continuous emergence of compute-intensive and delay-sensitive services in edge networks.However,the process of task migration is hindered by technical bottlenecks such as complex and time-varying application scenarios,as well as the high difficulty in problem modeling.Especially when considering user movement,designing a reasonable task migration strategy that ensures the stability and the continuity of user service remains a persistent challenge.Therefore,a mobile-aware service pre-caching model and task pre-migration strategy are proposed to transform the problem of task migration into an optimization problem that combines optimal clustering strategies with edge service pre-caching.First of all,the current state of the task is initially predicted based on the user′s movement trajectory.To solve the problem of when and where to migrate,a pre-migration model for two task scenarios,namely mobile and load,is proposed by introducing the concept of dynamic cooperation cluster and migration prediction radius.And then,according to the tasks that need to be migrated,the maximum tolerant delay constraint is utilized to derive the limit value of cooperative cluster radius and target server quantity in a cluster.Subsequently,a user-centric distributed dynamic multi-server cooperative clustering algorithm(DDMC) and a cache-based double deep Q network algorithm(C-DDQN) for service are proposed to solve the problem of optimal clustering and service ca-ching.Finally,a low-complexity alternate minimization service cache location update algorithm is designed using the causality of service caches to achieve the optimal set of migration target servers,which realize server collaboration and network load balancing in task migration.Experimental results demonstrate the robustness and the system performance of the proposed migration selection algorithm.Compared with other algorithms,the total cost consumed is reduced by at least 12.06%,the total latency consumed is reduced by at least 31.92%.

Key words: Mobile edge computing, Service cache, Dynamic collaborative cluster, Task migration, Deep reinforcement learning

CLC Number: 

  • TP393
[1]ZHANG J,HU X,NING Z,et al.Joint resource allocation for latency-sensitive services over mobile edge computing networks with caching [J].IEEE Internet of Things Journal,2018,6(3):4283-4294.
[2]MIAO Y,WU G,LI M,et al.Intelligent task prediction andcomputation offloading based on mobile-edge cloud computing [J].Future Generation Computer Systems,2020,102:925-931.
[3]ZHANG N,GUO S,DONG Y,et al.Joint task offloading and data caching in mobile edge computing networks [J].Computer Networks,2020,182:107446.
[4]PENG K,NIE J,KUMAR N,et al.Joint optimization of service chain caching and task offloading in mobile edge computing [J].Applied Soft Computing,2021,103:107142.
[5]LI C,ZHANG Y,GAO X,et al.Energy-latency tradeoffs for edge caching and dynamic service migration based on DQN in mobile edge computing [J].Journal of Parallel and Distributed Computing,2022,166:15-31.
[6]TANG F,LIU C,LI K,et al.Task migration optimization forguaranteeing delay deadline with mobility consideration in mobile edge computing [J].Journal of Systems Architecture,2020,112(8):101849.
[7]LI C,ZHU L,LI W,et al.Joint edge caching and dynamic service migration in SDN based mobile edge computing [J].Journal of Network and Computer Applications,2021,177:102966.
[8]OUYANG T,ZHOU Z,CHEN X.Follow me at the edge:Mo-bility-aware dynamic service placement for mobile edge computing [J].IEEE Journal on Selected Areas in Communications,2018,36(10):2333-2345.
[9]GE S,CHENG M,HE X,et al.A two-stage service migration algorithm in parked vehicle edge computing for internet of things [J].Sensors,2020,20(10):2786.
[10]YIN L,LI P,LUO J.Smart contract service migration mechanism based on container in edge computing [J].Journal of Pa-rallel and Distributed Computing,2021,152:157-166.
[11]WANG S,URGAONKAR R,ZAFER M,et al.Dynamic service migration in mobile edge computing based on Markov decision process [J].IEEE/ACM Transactions on Networking,2019,27(3):1272-1288.
[12]BI S,HUANG L,ZHANG Y J A.Joint optimization of service caching placement and computation offloading in mobile edge computing systems [J].IEEE Transactions on Wireless Communications,2020,19(7):4947-4963.
[13]XIE Q,WANG Q,YU N,et al.Dynamic service caching in mobile edge networks[C]//2018 IEEE 15th International Confe-rence on Mobile Ad Hoc and Sensor Systems(MASS).IEEE,2018:73-79.
[14]ZHAO T,HOU I H,WANG S,et al.Red/led:An asymptotically optimal and scalable online algorithm for service caching at the edge [J].IEEE Journal on Selected Areas in Communications,2018,36(8):1857-1870.
[15]CHEN L,XU J,REN S,et al.Spatio-temporal edge service placement:A bandit learning approach [J].IEEE Transactions on Wireless Communications,2018,17(12):8388-8401.
[16]ZHANG T,FAN H,LOO J,et al.User preference aware caching deployment for device-to-device caching networks [J].IEEE Systems Journal,2017,13(1):226-237.
[17]PENG T,WANG H,LIANG C,et al.Value-aware cache re-placement in edge networks for Internet of Things [J].Transactions on Emerging Telecommunications Technologies,2021,32(9):e4261.
[18]ZHANG W,WU D,YANG W,et al.Caching on the move:A user interest-driven caching strategy for D2D content sharing [J].IEEE Transactions on Vehicular Technology,2019,68(3):2958-2971.
[19]NAIR V,HINTON G E.Rectified linear units improve restric-ted boltzmann machines[C]//Proceedings of the 27th international conference on machine learning(ICML-10).2010:807-814.
[20]TALEB T,KSENTINI A,FRANGOUDIS P A.Follow-mecloud:When cloud services follow mobile users[J].IEEE Transactions on Cloud Computing,2016,7(2):369-382.
[21]MICHAEL M M,SCOTT M L.Nonblocking algorithms andpreemption-safe locking on multiprogrammed shared memory multiprocessors[J].Journal of parallel and distributed computing,1998,51(1):1-26.
[22]MEIZHEN W,YANLEI S,YUE T.The design and implementation of LRU-based web cache[C]//2013 8th International Conference on Communications and Networking in China(CHINACOM).IEEE,2013:400-404.
[23]SOKOLINSKY L B.LFU-K:An effective buffer managementreplacement algorithm[C]//Database Systems for Advanced Applications:9th International Conference(DASFAA 2004).Berlin Heidelberg:Springer,2004:670-681.
[24]CAO P,IRANI S.Cost-aware www proxy caching algorithms[C]//Usenix Symposium on Internet Technologies and Systems.1997:193-206.
[25]MNIH V,KAVUKCUOGLU K,SILVER D,et al.Human-level control through deep reinforcement learning [J].Nature,2015,518(7540):529-533.
[26]LI C,SONG M,ZHANG M,et al.Effective replica management for improving reliability and availability in edge-cloud computing environment [J].Journal of Parallel and Distributed Computing,2020,143:107-128.
[27]LI C,CAI Q,LOU Y.Optimal data placement strategy considering capacity limitation and load balancing in geographically distributed cloud [J].Future Generation Computer Systems,2022,127:142-159.
[1] WANG Zhihong, WANG Gaocai, ZHAO Qifei. Multi-objective Optimization of D2D Collaborative MEC Based on Improved NSGA-III [J]. Computer Science, 2024, 51(3): 280-288.
[2] LI Junwei, LIU Quan, XU Yapeng. Option-Critic Algorithm Based on Mutual Information Optimization [J]. Computer Science, 2024, 51(2): 252-258.
[3] SHI Dianxi, PENG Yingxuan, YANG Huanhuan, OUYANG Qianying, ZHANG Yuhui, HAO Feng. DQN-based Multi-agent Motion Planning Method with Deep Reinforcement Learning [J]. Computer Science, 2024, 51(2): 268-277.
[4] LIU Xingguang, ZHOU Li, ZHANG Xiaoying, CHEN Haitao, ZHAO Haitao, WEI Jibo. Edge Intelligent Sensing Based UAV Space Trajectory Planning Method [J]. Computer Science, 2023, 50(9): 311-317.
[5] LIN Xinyu, YAO Zewei, HU Shengxi, CHEN Zheyi, CHEN Xing. Task Offloading Algorithm Based on Federated Deep Reinforcement Learning for Internet of Vehicles [J]. Computer Science, 2023, 50(9): 347-356.
[6] JIN Tiancheng, DOU Liang, ZHANG Wei, XIAO Chunyun, LIU Feng, ZHOU Aimin. OJ Exercise Recommendation Model Based on Deep Reinforcement Learning and Program Analysis [J]. Computer Science, 2023, 50(8): 58-67.
[7] XIONG Liqin, CAO Lei, CHEN Xiliang, LAI Jun. Value Factorization Method Based on State Estimation [J]. Computer Science, 2023, 50(8): 202-208.
[8] ZHANG Naixin, CHEN Xiaorui, LI An, YANG Leyao, WU Huaming. Edge Offloading Framework for D2D-MEC Networks Based on Deep Reinforcement Learningand Wireless Charging Technology [J]. Computer Science, 2023, 50(8): 233-242.
[9] CHEN Xuzhan, LIN Bing, CHEN Xing. Stackelberg Model Based Distributed Pricing and Computation Offloading in Mobile Edge Computing [J]. Computer Science, 2023, 50(7): 278-285.
[10] LEI Xuemei, LIU Li, WANG Qian. MEC Offloading Model Based on Linear Programming Relaxation [J]. Computer Science, 2023, 50(6A): 211200229-5.
[11] CHEN Che, ZHENG Yifeng, YANG Jingmin, YANG Liwei, ZHANG Wenjie. Dynamic Energy Optimization Strategy Based on Relay Selection and Queue Stability [J]. Computer Science, 2023, 50(6A): 220100082-8.
[12] WANG Hanmo, ZHENG Shijie, XU Ruonan, GUO Bin, WU Lei. Self Reconfiguration Algorithm of Modular Robot Based on Swarm Agent Deep Reinforcement Learning [J]. Computer Science, 2023, 50(6): 266-273.
[13] ZHANG Qiyang, CHEN Xiliang, CAO Lei, LAI Jun, SHENG Lei. Survey on Knowledge Transfer Method in Deep Reinforcement Learning [J]. Computer Science, 2023, 50(5): 201-216.
[14] YU Ze, NING Nianwen, ZHENG Yanliu, LYU Yining, LIU Fuqiang, ZHOU Yi. Review of Intelligent Traffic Signal Control Strategies Driven by Deep Reinforcement Learning [J]. Computer Science, 2023, 50(4): 159-171.
[15] XU Linling, ZHOU Yuan, HUANG Hongyun, LIU Yang. Real-time Trajectory Planning Algorithm Based on Collision Criticality and Deep Reinforcement Learning [J]. Computer Science, 2023, 50(3): 323-332.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!