计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 446-459.doi: 10.11896/jsjkx.250600089
• 信息安全 • 上一篇
李瑞芮1,2, 郭瑞1,2, 张应辉1,2, 李雪雷3, 刘光军4
LI Ruirui1,2, GUO Rui1,2, ZHANG Yinghui1,2, LI Xuelei3, LIU Guangjun4
摘要: 联邦学习可以使用户在不共享原始数据的前提下,通过聚合本地模型更新参数来协同训练一个机器学习模型。然而,传统联邦学习中存在因过度依赖中央服务器而导致的单点故障、隐私泄露及通信瓶颈等问题。为此,提出一种去中心化的多边缘分布式联邦学习隐私保护方案。通过设计基于聚合多密钥同态加密方案(Aggregation Multi-Key Cheon-Kim-Kim-Song,AMK-CKKS)的本地模型聚合机制,实现对数据拥有者原始数据的隐私保护功能。此外,利用RingAllreduce算法构建分布式全局模型聚合框架,边缘服务器代替中央服务器进行全局模型聚合,以有效降低通信负载并消除对中心节点的依赖。同时,引入区块链和SG-PBFT共识机制,在确保模型更新参数可审计性的前提下,使节点快速达成共识,保证运行过程中诚实节点的安全性。安全性分析表明,所提方案不仅能确保模型更新参数的隐私性,而且能够抵抗k<(n-2)个参与方之间的合谋攻击;与相关方案相比,所提方案的模型准确度损失不超过3%,且通信开销降低约76%。
中图分类号:
| [1]ZHANG C,XIE Y,BAI H,et al.A survey on federated learning[J].Knowledge-Based Systems,2021,216:106775. [2]MCMAHAN B,MOORE E,RAMAGE D,et al.Communica-tion-efficient learning of deep networks from decentralized data[C]//Artificial Intelligence and Statistics.PMLR,2017:1273-1282. [3]MELIS L,SONG C,DE CRISTOFARO E,et al.Exploiting unintended feature leakage in collaborative learning[C]//2019 IEEE Symposium on Security and Privacy(SP).IEEE,2019:691-706. [4]SONG M,WANG Z,ZHANG Z,et al.Analyzing user-level privacy attack against federated learning[J].IEEE Journal on Selected Areas in Communications,2020,38(10):2430-2444. [5]GHOLAMI A,TORKZABAN N,BARAS J S.Trusted decentralized federated learning[C]//2022 IEEE 19th Annual Consumer Communications & Networking Conference(CCNC).IEEE,2022:1-6. [6]LIAN X,ZHANG C,ZHANG H,et al.Can decentralized algorithms outperform centralized algorithms?a case study for decentralized parallel stochastic gradient descent[J].arXiv:1705.09056,2017. [7]QU Y,XU C,GAO L,et al.Fl-sec:Privacy-preserving decen-tralized federated learning using signsgd for the internet of artificially intelligent things[J].IEEE Internet of Things Magazine,2022,5(1):85-90. [8]ZHU W,SHI L,LI J,et al.Trustworthy Blockchain-Assisted Federated Learning:Decentralized Reputation Management and Performance Optimization[J].IEEE Internet of Things Journal,2025,12(3):2890-2905. [9]XU L,CHEN Y,CHEN Y,et al.Swarm Learning for temporal and spatial series data in energy systems:A decentralized collaborative learning design based on blockchain[J].Applied Energy,2025,381:125053. [10]TIAN Y,WANG S,XIONG J,et al.Robust and privacy-preserving decentralized deep federated learning training:Focusing on digital healthcare applications[J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2024,21(4):890-901. [11]GENTRY C,HALEVI S.Implementing gentry's fully-homo-morphic encryption scheme[C]//Annual International Confe-rence on the Theory and Applications of Cryptographic Techniques.Berlin:Springer,2011:129-148. [12]SMART N P,VERCAUTEREN F.Fully homomorphic SIMD operations[J].Designs,Codes and Crytography,2014,71(1):57-81. [13]BRAKERSKI Z,VAIKUNTANATHAN V.Efficient fully homomorphic encryption from(standard) LWE[J].SIAM Journal on Computing,2014,43(2):831-871. [14]BRAKERSKI Z,GENTRY C,VAIKUNTANATHAN V.(Le-veled) fully homomorphic encryption without bootstrapping[C]//Proceedings of the 3rd Innovations in Theoretical Computer Science Conference.2012:309-325. [15]BRAKERSKI Z.Fully homomorphic encryption without modulus switching from classical GapSVP[C]//Annual Cryptology Conference.Berlin:Springer,2012:868-886. [16]FAN J,VERCAUTEREN F.Somewhat practical fully homo-morphic encryption[J].Cryptology ePrint Archive,2012,2012:144. [17]GENTRY C,SAHAI A,WATERS B.Homomorphic encryption from learning with errors:Conceptually-simpler,asymptotically-faster,attribute-based[C]//Advances in Cryptology-CRYPTO 2013:33rd Annual Cryptology Conference,Santa Barbara,CA,USA,August 18-22,2013.Proceedings,Part I.Berlin:Springer,2013:75-92. [18]CHEON J H,KIM A,KIM M,et al.Homomorphic encryption for arithmetic of approximate numbers[C]//Advances in Cryptology-ASIACRYPT 2017:23rd International Conference on the Theory and Applications of Cryptology and Information Security,Hong kong,China,December 3-7,2017,proceedings,part i 23.Springer International Publishing,2017:409-437. [19]CHEON J H,HAN K,KIM A,et al.Bootstrapping for approximate homomorphic encryption[C]//Advances in Cryptology-EUROCRYPT 2018:37th Annual International Conference on the Theory and Applications of Cryptographic Techniques,Tel Aviv,Israel,April 29-May 3,2018 Proceedings,Part I 37.Springer International Publishing,2018:360-384. [20]LÓPEZ-ALT A,TROMER E,VAIKUNTANATHAN V.On-the-fly multiparty computation on the cloud via multikey fully homomorphic encryption[C]//Proceedings of the Forty-fourth Annual ACM Symposium on Theory of Computing.2012:1219-1234. [21]MUKHERJEE P,WICHS D.Two round multiparty computa-tion via multi-key FHE[C]//Advances in Cryptology-EUROCRYPT 2016:35th Annual International Conference on the Theory and Applications of Cryptographic Techniques,Vienna,Austria,May 8-12,2016,Proceedings,Part II 35.Berlin:Sprin-ger,2016:735-763. [22]CHEN L,ZHANG Z,WANG X.Batched multi-hop multi-key FHE from ring-LWE with compact ciphertext extension[C]//Theory of Cryptography:15th International Conference(TCC 2017).Baltimore,MD,USA,Springer International Publishing,2017:597-627. [23]CHEN H,CHILLOTTI I,SONG Y.Multi-key homomorphicencryption from TFHE[C]//Advances in Cryptology-ASIACRYPT 2019:25th International Conference on the Theory and Application of Cryptology and Information Security,Kobe,Japan,December 8-12,2019,Proceedings,Part II 25.Springer International Publishing,2019:446-472. [24]CHEN H,DAI W,KIM M,et al.Efficient multi-key homomorphic encryption with packed ciphertexts with application to oblivious neural network inference[C]//Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security.2019:395-412. [25]WEN J M,LIU Q,CHEN J,et al.Research Current Status and Challenges of Fully Homomorphic Cryptography Based on Learning with Errors [J].Cyber Security,2024,24(9):1328-1351. [26]CASTRO M,LISKOV B.Practical byzantine fault tolerance[C]//OsDI.1999,99(1999):173-186. [27]AMARI S.Backpropagation and stochastic gradient descentmethod[J].Neurocomputing,1993,5(4/5):185-196. [28]CAI Y,DING W,XIAO Y,et al.Secfed:A secure and efficient federated learning based on multi-key homomorphic encryption[J].IEEE Transactions on Dependable and Secure Computing,2023,21(4):3817-3833. [29]AONO Y,HAYASHI T,WANG L,et al.Privacy-preservingdeep learning via additively homomorphic encryption[J].IEEE Transactions on Information Forensics and Security,2017,13(5):1333-1345. [30]ZHANG Q,JING S,ZHAO C,et al.Efficient federated learning framework based on multi-key homomorphic encryption[C]//Proceedings of the International Conference on P2P,Parallel,Grid,Cloud and Internet Computing.Springer,2022:88-105. [31]WU Z,SONG L T,LI X L.A Communication-Efficient Decentralized Hierarchical Federated Learning Architecture [J].Computer Applications Research,2025,42(5):1325-1330. [32]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-basedlearning applied to document recognition[J].Proceedings of the IEEE,2002,86(11):2278-2324. [33]KRIZHEVSKY A,HINTON G.Learning multiple layers of features from tiny images[J].Handbook of Systemic Autoimmune Diseases,2009,1(4):1-60. |
|
||