计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 137-144.doi: 10.11896/jsjkx.251000114

• 高性能计算 • 上一篇    下一篇

基于Kokkos的直接求解器及其在异构平台上的实现

李珍佳, 王武   

  1. 中国科学院计算机网络信息中心 北京 100190
    中国科学院大学 北京 100049
  • 收稿日期:2025-10-27 修回日期:2025-12-22 出版日期:2026-06-15 发布日期:2026-06-09
  • 通讯作者: 王武(wangwu@sccas.cn)
  • 作者简介:(lizhenjia@cnic.cn)
  • 基金资助:
    国家重点研发计划高性能计算专项课题(2025YFB3003305);中国科学院计算机网络信息中心青年基金(25YF07)

Kokkos-based Direct Solver and Its Implementation on Heterogeneous Platform

LI Zhenjia, WANG Wu   

  1. Computer Network Information Center,Chinese Academy of Sciences,Beijing 100190,China
    University of Chinese Academy of Sciences,Beijing 100049,China
  • Received:2025-10-27 Revised:2025-12-22 Published:2026-06-15 Online:2026-06-09
  • About author:LI Zhenjia,born in 2000,postgraduate.Her main research interests include parallel computing and the solution of dense linear systems.
    WANG Wu,born in 1982,Ph.D,associate researcher,is a member of CCF(No.96330M).His main research interests include parallel algorithm and high performance computing.
  • Supported by:
    National Key R & D Program--High Performance Computing Project(2025YFB3003305) and Youth Fund of Computer Network Information Center of Chinese Academy of Sciences(25YF07).

摘要: 文中实现了一种基于 Kokkos 的高效并行 LU 直接求解器,用于在加速卡异构系统上求解电磁矩量法(MoM)产生的大规模复稠密线性方程组。求解器利用 Kokkos∷parallel_for 在 GPU 上高效并行填充阻抗矩阵和激励电压向量;基于求解结果,在主机端遍历观测角度并合成散射场以计算 RCS,整体流程高效且具备良好的可扩展性。在基于 DCU 加速卡的“东方”超级计算平台上对求解器进行了性能评估。实验分析了二维处理器划分策略对性能与通信开销的影响。结果表明,在 16 个进程(16 张 DCU)下,将每行处理器数由 1 增至 4 时,计算性能提升 40.7%,通信开销占比显著下降,从 64.71% 降至 55.07%。合理配置每行处理器数量能够有效平衡计算与通信负载,显著降低通信开销,从而提升整体并行计算效率。在 64 张 DCU 上,求解器浮点性能达到 16 655.73 GFLOP/s;当规模扩展至 2 048 张 DCU 时,浮点性能进一步提升至 58 338.90 GFLOP/s,展现出良好的可扩展性。针对弱可扩展性测试,当 DCU 数由 4 张扩展至 2 048 张时,并行效率为 24.45%。测试结果表明,基于 Kokkos 的直接求解器在高性能异构平台上具备优异的性能表现,能够满足大规模电磁仿真的计算需求。

关键词: Kokkos, 矩量法, 并行LU分解, 深度计算单元, 异构计算

Abstract: A high-performance parallel LU direct solver based on the Kokkos framework is developed for solving large complex dense linear systems arising from the method of moments(MoM)in electromagnetic simulations on accelerator-based heterogeneous systems.The impedance matrix and excitation vector are efficiently filled in parallel on the GPU using Kokkos∷parallel_for.Based on the computed solution,the radar cross section(RCS)is obtained on the host by traversing observation angles and synthesizing the scattered field.The overall workflow is efficient and demonstrates good scalability.Performance evaluation is conducted on the “ORISE” supercomputing platform equipped with deep computing unit(DCU)accelerators.The impact of two-dimensional processor grid strategies on performance and communication overhead is analyzed.Under 16 processes,increasing the number of processors per row from 1 to 4 results in a 40.7% performance improvement and a reduction in communication overhead from 64.71% to 55.07%.Proper processor grid configuration effectively balances computation and communication,significantly reducing communication overhead and enhancing overall parallel efficiency.With 64 DCUs,the solver achieves a peak performance of 16 655.73 GFLOP/s,and when scaled to 2 048 DCUs,the performance increases to 58 338.90 GFLOP/s,showing good scalability.In the weak scalability test,the solver attains a parallel efficiency of 24.45% when scaling from 4 to 2 048 DCUs.These results indicate that the Kokkos-based direct solver delivers strong performance and is well-suited for large-scale electromagnetic simulation on heterogeneous high-performance computing platforms.

Key words: Kokkos, Method of moments, Parallel LU decomposition, Deep computing unit, Heterogeneous computing

中图分类号: 

  • TP391
[1]HARRINGTON R F.Field Computation by Moment Methods[M].Wiley-IEEE Press,1993.
[2]CHEN Y,ZUO S,ZHANG Y,et al.Large-scale parallel method of moments on CPU/MIC heterogeneous clusters [J].IEEE Transactions on Antennas and Propagation,2017,65(7):3782-3787.
[3]MIRHOSSEINI A,SADROSADATI M,SOLTANI B,et al.BiNoCHS:Bimodal network-on-chip for CPU-GPU heterogeneous systems [C]//Proceedings of the Eleventh IEEE/ACM International Symposium on Networks-on-Chip.IEEE,2017:1-8.
[4]TOP500.November 2024 | TOP500 [EB/OL].(2024-11)[2025-10-23].https://top500.org/lists/top500/2024/11/.
[5]JIA R P,LIN Z C,ZUO S,et al.Research on large-scale parallel method of moments for domestic heterogeneous DCU platform [J].Journal of Xidian University,2023,51(2):76-83.
[6]SHUI C Y,YU X Z,WANG Y S,et al.Optimization and analysis of HPL on domestic heterogeneous systems [J].Journal of Software,2021,32(8):2319-2328.
[7]HE W J,KONG Y N,HE K F,et al.Massively parallel ap-proach of multilevel fast multipole algorithm on DCU clusters for large electromagnetic scattering problems [C]//2021 International Applied Computational Electromagnetics Society(ACES-China)Symposium.IEEE,2021:1-2.
[8]EDWARDS H C,TROTT C R,SUNDERLAND D.Kokkos:Enabling manycore performance portability through polymorphic memory access patterns [J].Journal of Parallel and Distributed Computing,2014,74(12):3202-3216.
[9]DANG V Q,KOTULSKI J D,RAJAMANICKAM S.ADE-LUS:A performance-portable dense LU solver for distributed-memory hardware-accelerated systems [C]//International Workshop on Accelerator Programming Using Directives.Cham:Springer,2020:80-101.
[10]LIANG Z,LI K,ZHANG X,et al.Development of performance portable solver based on Kokkos template metaprogramming [J].Frontiers of Data and Computing,2024,6(1):12-20.
[11]BALANIS C A.Balanis' Advanced Engineering Electromagne-tics [M].John Wiley & Sons,2024.
[12]PETERSON A F,RAY S L,MITTRA R,et al.Computational Methods for Electromagnetics [M].New York:IEEE,1998.
[13]CHEN C,FANG J,TANG T,et al.LU factorization on heterogeneous systems:an energy-efficient approach towards high performance [J].Computing,2017,99:791-811.
[14]WANG C,CHEN L.Performance Portability Analysis of CFD Solver Based on Kokkos[J].Computer Systems Applications,2025,34(4):248-255.
[15]RAJAMANICKAM S,ACER S,BERGER-VERGIAT L,et al.Kokkos kernels:Performance portable sparse/dense linear algebra and graph kernels [J].arXiv:2103.11991,2021.
[16]TOLEDO S.Locality of reference in LU decomposition withpartial pivoting [J].SIAM Journal on Matrix Analysis and Applications,1997,18(4):1065-1081.
[17]HOCKNEY R W.The communication challenge for MPP:Intel Paragon and Meiko CS-2 [J].Parallel Computing,1994,20(3):389-398.
[18]IRONY D,TOLEDO S,TISKIN A.Communication lowerbounds for distributed-memory matrix multiplication [J].Journal of Parallel and Distributed Computing,2004,64(9):1017-1026.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!