Computer Science ›› 2024, Vol. 51 ›› Issue (6): 354-363.doi: 10.11896/jsjkx.230400183

• Computer Network • Previous Articles     Next Articles

Federated Learning Client Selection Scheme Based on Time-varying Computing Resources

LIU Jianxun, ZHANG Xinglin   

  1. School of Computer Science & Engineering,South China University of Technology,Guangzhou 510006,China
  • Received:2023-04-21 Revised:2024-01-04 Online:2024-06-15 Published:2024-06-05
  • About author:LIU Jianxun,born in 1998,postgra-duate.His main research interest is fe-derated learning.
    ZHANG Xinglin,born in 1987,Ph.D,professor,is a member of CCF(No.41400M).His main research interests include mobile edge computing and mobile crowdsensing.
  • Supported by:
    National Natural Science Foundation of China(62372185) and Guangdong Regional Joint Funds for Basic and Applied Research(2021B1515120078).

Abstract: Federated learning(FL) is an emerging paradigm for distributed machine learning,whose core idea is that user devices train their models locally in a distributed manner and do not need to upload raw data,but only upload the trained model to the server for model aggregation.Most of the existing studies ignore that the computing resources of devices change temporally with the usage patterns of users,which can affect the training of FL.In this paper,we model time-varying computing resources for he-terogeneous devices using an auto regressive model and propose a client selection algorithm.We first formulate the optimization problem of minimizing the average training time of each round of FL under the long-term training time constraint,then transform it using Lyapunov optimization theory,and finally solve it to obtain the client selection algorithm.Experimental results show that compared with the baseline algorithms,the proposed algorithm can reduce the training time of FL and the average waiting time of the devices while basically remaining the quality of model.

Key words: Federated learning, Client selection, Time-varying computing resources, Unbalanced data

CLC Number: 

  • TP39
[1]LIU Y,BI S,SHI Z,et al.When machine learning meets big data:A wireless communication perspective[J].IEEE Vehicular Technology Magazine,2019,15(1):63-72.
[2]SUN Y,PENG M,ZHOU Y,et al.Application of machine lear-ning in wireless networks:Key techniques and open issues[J].IEEE Communications Surveys & Tutorials,2019,21(4):3072-3108.
[3]YANG Q,LIU Y,CHENG Y,et al.Federated Learning[M].Beijing:Publishing House of Electronics Industry,2020.
[4]MCMAHAN B,MOORE E,RAMAGE D,et al.Communication-efficient learning of deep networks from decentralized data[C]//Artificial Intelligence and Statistics.PMLR,2017:1273-1282.
[5]BONAWITZ K,EICHNER H,GRIESKAMP W,et al.Towards federated learning at scale:System design[J].Proceedings of Machine Learning and Systems,2019,1:374-388.
[6]WANG H,KAPLAN Z,NIU D,et al.Optimizing federatedlearning on non-iid data with reinforcement learning[C]//IEEE Conference on Computer Communications(INFOCOM 2020).IEEE,2020:1698-1707.
[7]NISHIO T,YONETANI R.Client selection for federated lear-ning with heterogeneous resources in mobile edge[C]//2019 IEEE International Conference on Communications(ICC 2019).IEEE,2019:1-7.
[8]ZENG Q,DU Y,HUANG K,et al.Energy-efficient radio re-source allocation for federated edge learning[C]//2020 IEEE International Conference on Communications Workshops(ICC Workshops).IEEE,2020:1-6.
[9]LI L,XIONG H,GUO Z,et al.SmartPC:Hierarchical pace control in real-time federated learning system[C]//IEEE Real-Time Systems Symposium(RTSS 2019).IEEE,2019:406-418.
[10]WANG C,YANG Y,ZHOU P.Towards efficient scheduling of federated mobile devices under computational and statistical he-terogeneity[J].IEEE Transactions on Parallel and Distributed Systems,2020,32(2):394-410.
[11]YU L,ALBELAIHI R,SUN X,et al.Jointly optimizing client selection and resource management in wireless federated lear-ning for Internet of things[J].IEEE Internet of Things Journal,2022,9(6):4385-4395.
[12]WADU M M,SAMARAKOON S,BENNIS M.Joint clientscheduling and resource allocation under channel uncertainty in federated learning[J].IEEE Transactions on Communications,2021,69(9):5962-5974.
[13]CHEN M,YANG Z,SAAD W,et al.A joint learning and communications framework for federated learning over wireless networks[J].IEEE Transactions on Wireless Communications,2021,20(1):269-283.
[14]XU J,WANG H.Client selection and bandwidth allocation inwireless federated learning networks:A long-term perspective[J].IEEE Transactions on Wireless Communications,2021,20(2):1188-1200.
[15]ABDULRAHMAN S,TOUT H,MOURAD A,et al.Fed-MCCS:Multicriteria client selection model for optimal IoT fe-derated learning[J].IEEE Internet of Things Journal,2021,8(6):4723-4735.
[16]BRIGGS C,FAN Z,ANDRAS P.Federated learning with hie-rarchical clustering of local updates to improve training on non-IID data[C]//2020 International Joint Conference on Neural Networks(IJCNN).IEEE,2020:1-9.
[17]WU H,WANG P.Node selection toward faster convergence for federated learning on non-iid data[J].IEEE Transactions on Network Science and Engineering,2022,9(5):3099-3111.
[18]XIA W,QUEK T Q S,GUO K,et al.Multi-armed bandit-based client scheduling for federated learning[J].IEEE Transactions on Wireless Communications,2020,19(11):7108-7123.
[19]HUANG T,LIN W,WU W,et al.An efficiency-boosting client selection scheme for federated learning with fairness guarantee[J].IEEE Transactions on Parallel and Distributed Systems,2021,32(7):1552-1564.
[20]ZHU H,ZHOU Y,QIAN H,et al.Onlineclient selection forasynchronous federated learning with fairness consideration[J].IEEE Transactions on Wireless Communications,2023,22(4):2493-2506.
[21]LAI F,ZHU X,MADHYASTHA H V,et al.Oort:Efficientfederated learning via guided participant selection[C]//OSDI.2021:19-35.
[22]NEELY M J.Stochastic network optimization with applicationto communication and queueing systems[J].Synthesis Lectures on Communication Networks,2010,3(1):1-211.
[23]WU W,HE L,LIN W,et al.Accelerating federated learningover reliability-agnostic clients in mobile edge computing systems[J].IEEE Transactions on Parallel and Distributed Systems,2020,32(7):1539-1551.
[24]MA Z,XU Y,XU H,et al.Adaptive Batch Size for Federated Learning in Resource-Constrained Edge Computing[J].IEEE Transactions on Mobile Computing,2023,22(1):37-53.
[1] XU Yicheng, DAI Chaofan, MA Wubin, WU Yahui, ZHOU Haohao, LU Chenyang. Particle Swarm Optimization-based Federated Learning Method for Heterogeneous Data [J]. Computer Science, 2024, 51(6): 391-398.
[2] LU Yanfeng, WU Tao, LIU Chunsheng, YAN Kang, QU Yuben. Survey of UAV-assisted Energy-Efficient Edge Federated Learning [J]. Computer Science, 2024, 51(4): 270-279.
[3] WANG Degang, SUN Yi, GAO Qi. Active Membership Inference Attack Method Based on Multiple Redundant Neurons [J]. Computer Science, 2024, 51(4): 373-380.
[4] WANG Xin, HUANG Weikou, SUN Lingyun. Survey of Incentive Mechanism for Cross-silo Federated Learning [J]. Computer Science, 2024, 51(3): 20-29.
[5] HUANG Nan, LI Dongdong, YAO Jia, WANG Zhe. Decentralized Federated Continual Learning Method Combined with Meta-learning [J]. Computer Science, 2024, 51(3): 271-279.
[6] WANG Xun, XU Fangmin, ZHAO Chenglin, LIU Hongfu. Defense Method Against Backdoor Attack in Federated Learning for Industrial Scenarios [J]. Computer Science, 2024, 51(1): 335-344.
[7] WANG Zhousheng, YANG Geng, DAI Hua. Lightweight Differential Privacy Federated Learning Based on Gradient Dropout [J]. Computer Science, 2024, 51(1): 345-354.
[8] ZHAO Yuhao, CHEN Siguang, SU Jian. Privacy-enhanced Federated Learning Algorithm Against Inference Attack [J]. Computer Science, 2023, 50(9): 62-67.
[9] LIN Xinyu, YAO Zewei, HU Shengxi, CHEN Zheyi, CHEN Xing. Task Offloading Algorithm Based on Federated Deep Reinforcement Learning for Internet of Vehicles [J]. Computer Science, 2023, 50(9): 347-356.
[10] LI Rongchang, ZHENG Haibin, ZHAO Wenhong, CHEN Jinyin. Data Reconstruction Attack for Vertical Graph Federated Learning [J]. Computer Science, 2023, 50(7): 332-338.
[11] ZHANG Lianfu, TAN Zuowen. Robust Federated Learning Algorithm Based on Adaptive Weighting [J]. Computer Science, 2023, 50(6A): 230200188-9.
[12] ZHONG Jialin, WU Yahui, DENG Su, ZHOU Haohao, MA Wubin. Multi-objective Federated Learning Evolutionary Algorithm Based on Improved NSGA-III [J]. Computer Science, 2023, 50(4): 333-342.
[13] WU Fei, SONG Yibo, JI Yimu, XU Xi, WANG Musen, JING Xiaoyuan. Contribution-based Federated Learning Approach for Global Imbalanced Problem [J]. Computer Science, 2023, 50(12): 343-348.
[14] LI Renjie, YAN Qiao. Inter-cluster Optimization for Cluster Federated Learning [J]. Computer Science, 2023, 50(11A): 221000243-5.
[15] WANG Chundong, DU Yingqi, MO Xiuliang, FU Haoran. Enhanced Federated Learning Frameworks Based on CutMix [J]. Computer Science, 2023, 50(11A): 220800021-8.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!