Computer Science ›› 2022, Vol. 49 ›› Issue (12): 53-58.doi: 10.11896/jsjkx.220700136

• Federated Leaming • Previous Articles     Next Articles

Federated Learning Optimization Method for Dynamic Weights in Edge Scenarios

CHENG Fan, WANG Rui-jin, ZHANG Feng-li   

  1. School of Information and Software Engineering,University of Electronic Science and Technology of China,Chengdu 610054,China
  • Received:2022-07-15 Revised:2022-09-08 Published:2022-12-14
  • About author:CHENG Fan,born in 1999,postgra-duate,is a member of China Computer Federation.His main research interests include federated learning and edge computing.WANG Rui-jin,born in 1980,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include edge computing,blockchain,artificial intelligence and information security.
  • Supported by:
    National Natural Science Foundation of China(62271128) and Key R & D Projects of Sichuan Science and Technology Program(2022ZDZX0004,23ZDYF0706,23ZDYF0085,2022YFG0212,2021YFS0391,2021YFG0027,2020YFG0475,2019YJ0543).

Abstract: As a new computing paradigm,edge computing provides computing and storage services at the edge of the network compared to traditional cloud computing model.It has the characteristics of high reliability and low latency.However,there are still some problems in privacy protection and data processing.As a distributed machine learning model,federated learning can well solve the problems of inconsistent data distribution and data privacy in edge computing scenarios,but it still faces challenges in equipment heterogeneity,data heterogeneity and communication,such as model offset,the convergence effect is poor,and the calculation results of some devices are lost.In order to solve the above problems,a federated learning optimization algorithm with dynamic weights(FedDw) is proposed,which focuses on the service quality of the equipment,reduces the heterogeneous impact caused by the participation of some equipments due to inconsistent training speed,and determines the proportion in the final mo-del aggregation according to the service quality,so as to ensure that the aggregation results are more robust in complex real situations.Through experiments,the two excellent federated learning algorithms,FedProx and Scaffold,are compared on the real data sets of 10 regional weather stations.The results show that the FedDw algorithm has better comprehensive performance.

Key words: Federal learning, Edge computing, Wind energy forecasting, Equipment heterogeneity, Dynamic weights

CLC Number: 

  • TP391
[1]ZHOU Y Z,ZHANG D.Near-ENF cloud computing:opportunities and challenges in the post-cloud computing Era[J].Chinese Journal of Computers,2019,42(4):677-700.
[2]CUI Y,SONG J,MIAO C C,et al.Mobile cloud computing research progress and trends[J].Chinese Journal of Computers,2017,40(2):273-295.
[3]ARRIETA A B,DÍAZ-RODRÍGUEZ N,DEL SER J,et al.ExplainableArtificial Intelligence (XAI):Concepts,taxonomies,opportunities and challenges toward responsible AI[J].Information Fusion,2020,58:82-115.
[4]SHI W S,SUN H,CAO J,et al.Edge computing—an emerging computing model for the internet of everything era[J].Journal of Computer Research and Development,2017,54 (5):907-924.
[5]WANG R,PEI X,ZHU J,et al.Multivariable time series forecasting using model fusion[J].Information Sciences,2022,585:262-274.
[6]WANG R J,LAI J S,ZHANG Z Y,et al.Privacy-PreservingFederated Learning for Internet of Medical Things under Edge Computing[J/OL].IEEE Journal of Biomedical and Health Informatics,2022.https://ieeexplore.ieee.org/document/9729996.
[7]KAIROUZ P,MCMAHAN H B,AVENT B,et al.Advancesand open problems in federated learning[J].Foundations and Trends® in Machine Learning,2021,14(1/2):1-210.
[8]YANG Q.Federated learning and artificial intelligence[J].Software and Integrated Circuit,2019,5(11):961-965.
[9]KHAN L U,SAAD W,HAN Z,et al.Federated learning for internet of things:Recent advances,taxonomy,and open challenges[J].IEEE Communications Surveys & Tutorials,2021,23(3):1759-1799.
[10]KONEČNÝ J,MCMAHAN H B,YU F X,et al.Federated learning:Strategies for improving communication efficiency[J].arXiv:1610.05492,2016.
[11]ZHANG Y L,CHEN Y X,TIAN H,et al.Survey on Federated Learning Application on Scenarios of Edge Computing[J].Journal of Chinese Computer Systems,2021,42(12):2645-2653.
[12]ZHAO Y,LI M,LAI L,et al.Federated learning with non-iid data[J].arXiv:1806.00582,2018.
[13]MCMAHAN B,MOORE E,RAMAGE D,et al.Communica-tion efficient learning of deep networks from decentralized data:Artificial intelligence and statistics[C]//PMLR.2017.
[14]LI T,SAHU A K,ZAHEER M,et al.Federated optimization in heterogeneous networks[C]//Proceedings of Machine Learning and Systems.2020:429-450.
[15]WANG J,LIU Q,LIANG H,et al.Tackling the objective inconsistency problem in heterogeneous federated optimization[J].Advances in Neural Information Processing Systems,2020,33:7611-7623.
[16]KARIMIREDDY S P,KALE S,MOHRI M,et al.Scaffold:Stochastic controlled averaging for federated learning:International Conference on Machine Learning[C]//PMLR.2020.
[17]PENG X,HUANG Z,ZHU Y,et al.Federated adversarial domain adaptation[J].arXiv:1911.02054,2019.
[18]SERRA J,SURIS D,MIRON M,et al.Overcoming catastrophic forgetting with hard attention to the task:International Confe-rence on Machine Learning[C]//PMLR.2018.
[19]QU L,ZHOU Y,LIANG P P,et al.Rethinking ArchitectureDesign for Tackling Data Heterogeneity in Federated Learning[J].arXiv:2106.06047,2021.
[20]ZHANG M,SAPRA K,FIDLER S,et al.Personalized federated learning with first order model optimization[J].arXiv:2012.08565,2020.
[21]LI L,DUAN M,LIU D,et al.FedSAE:A novel self-adaptive federated learning framework in heterogeneous systems:2021 International Joint Conference on Neural Networks(IJCNN)[C]//IEEE.2021.
[22]REISIZADEH A,TAHERI H,MOKHTARI A,et al.Robust and communication-efficient collaborative learning[C]//Advances in Neural Information Processing Systems.2019.
[1] SUN Hui-ting, FAN Yan-fang, MA Meng-xiao, CHEN Ruo-yu, CAI Ying. Dynamic Pricing-based Vehicle Collaborative Computation Offloading Scheme in VEC [J]. Computer Science, 2022, 49(9): 242-248.
[2] YU Bin, LI Xue-hua, PAN Chun-yu, LI Na. Edge-Cloud Collaborative Resource Allocation Algorithm Based on Deep Reinforcement Learning [J]. Computer Science, 2022, 49(7): 248-253.
[3] LI Meng-fei, MAO Ying-chi, TU Zi-jian, WANG Xuan, XU Shu-fang. Server-reliability Task Offloading Strategy Based on Deep Deterministic Policy Gradient [J]. Computer Science, 2022, 49(7): 271-279.
[4] FANG Tao, YANG Yang, CHEN Jia-xin. Optimization of Offloading Decisions in D2D-assisted MEC Networks [J]. Computer Science, 2022, 49(6A): 601-605.
[5] LIU Zhang-hui, ZHENG Hong-qiang, ZHANG Jian-shan, CHEN Zhe-yi. Computation Offloading and Deployment Optimization in Multi-UAV-Enabled Mobile Edge Computing Systems [J]. Computer Science, 2022, 49(6A): 619-627.
[6] YUAN Hao-nan, WANG Rui-jin, ZHENG Bo-wen, WU Bang-yan. Design and Implementation of Cross-chain Trusted EMR Sharing System Based on Fabric [J]. Computer Science, 2022, 49(6A): 490-495.
[7] XIE Wan-cheng, LI Bin, DAI Yue-yue. PPO Based Task Offloading Scheme in Aerial Reconfigurable Intelligent Surface-assisted Edge Computing [J]. Computer Science, 2022, 49(6): 3-11.
[8] ZHANG Hai-bo, ZHANG Yi-feng, LIU Kai-jian. Task Offloading,Migration and Caching Strategy in Internet of Vehicles Based on NOMA-MEC [J]. Computer Science, 2022, 49(2): 304-311.
[9] LIN Chao-wei, LIN Bing, CHEN Xing. Study on Scientific Workflow Scheduling Based on Fuzzy Theory Under Edge Environment [J]. Computer Science, 2022, 49(2): 312-320.
[10] GAO Yue-hong, CHEN Lu. Survey of Research on Task Offloading in Mobile Edge Computing [J]. Computer Science, 2022, 49(11A): 220400161-7.
[11] ZHANG Xiao-mei, CAO Ying, LOU Ping, JIANG Xue-mei, YAN Jun-wei, LI Da. Lossless Data Compression Method Based on Edge Computing [J]. Computer Science, 2022, 49(11A): 210500195-6.
[12] YUAN Xin-wang, XIE Zhi-dong, TAN Xin. Survey of Resource Management Optimization of UAV Edge Computing [J]. Computer Science, 2022, 49(11): 234-241.
[13] HU Zhao-xia, HU Hai-zhou, JIANG Cong-fengand WAN Jian. Workload Characteristics Based Performance Optimization for Edge Intelligence [J]. Computer Science, 2022, 49(11): 266-276.
[14] LI Xiao-bo, CHEN Peng, SHUAI Bin, XIA Yun-ni, LI Jian-qi. Novel Predictive Approach to Trajectory-aware Online Edge Service Allocation in Edge Environment [J]. Computer Science, 2022, 49(11): 277-283.
[15] LIANG Jun-bin, ZHANG Hai-han, JIANG Chan, WANG Tian-shu. Research Progress of Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing [J]. Computer Science, 2021, 48(7): 316-323.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!