计算机科学 ›› 2019, Vol. 46 ›› Issue (8): 84-88.doi: 10.11896/j.issn.1002-137X.2019.08.013

• 2018 全国高性能计算学术年会 • 上一篇    下一篇

基于非结构化网格的高可扩展并行有限体积格子

徐磊1, 陈荣亮1, 蔡小川2   

  1. (中国科学院深圳先进技术研究院 广东 深圳518055)1
    (美国科罗拉多大学博尔德分校计算机系 博尔德80309)2
  • 收稿日期:2018-09-21 出版日期:2019-08-15 发布日期:2019-08-15
  • 通讯作者: 陈荣亮(1984-),男,博士,副研究员,主要研究方向为并行计算和计算流体力学,E-mail:rl.chen@siat.ac.cn
  • 作者简介:徐磊(1987-),男,博士,助理研究员,CCF会员,主要研究方向为并行计算;蔡小川(1962-),男,博士,教授,主要研究方向为计算数学、并行计算和计算流体力学
  • 基金资助:
    国家重点研发计划高性能计算重点专项(2016YFB0200601),深圳市E级工程与科学计算重点实验室(ZDSYS201703031711426),深圳市基础研究项目(JCYJ20160331193229720,JCYJ20170307165328836),国家自然科学基金(61531166003)

Scalable Parallel Finite Volume Lattice Boltzmann Method Based on Unstructured Grid

XU Lei1, CHEN Rong-liang1, CAI Xiao-chuan2   

  1. (Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,Shenzhen,Guangdong 518055,China)1
    (Department of Computer Science,University of Colorado Boulder,Boulder 80309,USA)2
  • Received:2018-09-21 Online:2019-08-15 Published:2019-08-15

摘要: 均匀网格格子Boltzmann方法虽然有其优势,但是在模拟大规模流场信息以及复杂几何边界时仍然存在困难。为此,文中给出了非结构化网格下的有限体积格子Boltzmann方法。该方法采用cell-centered方案,使用low-diffusion Roe方案计算对流通量密度,通过最小二乘方法计算粒子分布函数的梯度。为了能够模拟大规模复杂流场情况,文中给出了非结构化网格有限体积格子Boltzmann方法的并行方法。该法通过ParMETIS划分流场的非结构化网格,将网格近似平均地发送给MPI进程,比较了两种不同规模的网格单元的并行性能。文中通过以下两点验证了并行算法的正确性:1)顶盖方腔驱动流,Re=400,1 000,3 200,5 000;2)圆柱绕流,Re=10,20,40。并行数值实验的结果表明所提并行算法在1 920核上仍然拥有良好的可扩展性,在1 920个核上的并行效率可以达到在240核上效率的78.42%。

关键词: ParMETIS, 并行计算, 非结构化网格, 有限体积格子Boltzmann方法

Abstract: Although the lattice Boltzmann method (LBM) has become an effective and promising approach in computational fluid dynamics (CFD),it is still difficult to simulate large-scale flow field with complex geometric boundaries.In this paper,the finite volume lattice Boltzmann method with cell-centered scheme on unstructured grids was given.The convective fluxes are evaluated by low-diffusion Roe scheme,and the gradients of the particle distribution function are computed with Green-Gauss approach.In order to simulate large-scale complex flow field,a parallel algorithm for the finite volume lattice Boltzmann method on unstructured grids was presented.In this method,ParMETIS is applied to partition the unstructured mesh,and then the partitioned meshes are sent to the MPI processes.The parallel performance of two kinds of meshes are compared.The correctness of the parallel algorithm was verified by two benchmark flows:1)the lid-driven flow with Re=400,1 000,3 200,5 000;2)the steady viscous flowpast a circular cylinder with Re=10,20,40.The results of parallel numerical experiments show that the parallel algorithm still has good scalability on 1 920 cores,which achieves 78.42% efficiency on 1 920 cores compared with 240 cores

Key words: Finite volume lattice Boltzmann method, Parallel computing, ParMETIS, Unstructured grid

中图分类号: 

  • TP391
[1]CHEN S,CHEN H,MARTINEZ D.Lattice Boltzmann model for simulation of magnetohydrodynamics [J].Physical Review Letters,1991,67(27):3776-3780.
[2]QIAN Y H,D’HUMIÉRES D,LALLEMAND P.Lattice BGK model for Navier-Stokes equation [J].Europhysics Letters,1992,17(6):479-484.
[3]D’HHUMIÉRES D.Generalized lattice Boltzmann equations [C]∥Rarefied Gas Dynamics:Theory and Simulations,Progress in Astronautics and Aeronautics.Reston:AIAA,1992:450-458.
[4]D’HUMIÉRESD,GINZBURG I,KRAFCZYK M.Multiple-relaxation-time lattice Boltzmann models in three dimensions [J].Philosophical Transactions Mathematical Physical & Enginee-ring Sciences,2002,360(1792):437-451.
[5]PATIL D V,LAKSHMISHA K N.Finite volume TVD formulation of lattice Boltzmann simulation on unstructured mesh [J].Journal of Computational Physics,2009,228(14):5262-5279.
[6]PATIL D V.Chapman-Enskog analysis for finite-volume formulation of lattice Boltzmann equation[J].Physica A,2013,392 (12):2701-2712.
[7]MISZTAL M K,HERNANDEZ-GARCIA A,MATIN R,et al.Detailed analysis of the lattice Boltzmann method on unstructured grids [J].Journal of Computational Physics,2015,297:316-339.
[8]LI W,LUO L S.Finite Volume Lattice Boltzmann Method for Nearly Incompressible Flows on Arbitrary Unstructured Meshes [J].Communications in Computational Physics,2016,20(2):301-324.
[9]LI W,LUO L S.An implicit block LU-SGS finite-volume lattice-Boltzmann scheme for steady flows on arbitrary unstructured meshes [J].Journal of Computational Physics,2016,327:503-518.
[10]CHEN L,SCHAEFER L A.A unified and preserved Dirichlet boundary treatment for the cell-centered finite volume discrete Boltzmann method [J].Physics of Fluids,2015,27(2):027104.
[11]SCHEPKE C,MAILLARD N,NAVAUX P.Parallel Lattice Boltzmann Method with Blocked Partitioning [J].International Journal of Parallel Programming,2009,37(6):593-611.
[12]HONG P,HUANG L,LIN L,et al.Scalable multi-relaxation- time lattice Boltzmann simulations on multi-GPU cluster [J].Computer & Fluids,2015,110:1-8.
[13]BLAZEK J.Computational Fluid Dynamics Principles and Ap- plications [M].Berlin,Germany:Elevier,2015.
[14]BERGER M,AFTOSMIS M J,MURMAN S M.Analysis of slope limiters on Irregular Grids [C]∥43 AIAA Aerospace Scien-ces Meeting.Reno:AIAA,2005:10-13.
[15]KARYPIS G,SCHLOEGE K.ParMETIS:parallel graph parti- tioning and sparsematrix ordering library[D].Minneaplis:University of Minnesota,2013.
[16]BALAY S,ABHYANKAR S,ADAMS M,et al.PETScusers manual,Argonne,Argonne National Laboratory.https://www.mcs.anl.gov/petsc/documentation/referencing.html.
[17]GHIA U,GHIA K,SHIN C.High-Re solutions for incompressible flow using the Navier-Stokes equations and a multigrid method [J].Journal of Computational Physics,1982,48(3):387-411.
[18]VANKAS.Block-implicit multigrid solution of Navier-Stokes equations in primitive variables[J].Journal of Computational Physics,1986,65(1):138-158.
[1] 陈鑫, 李芳, 丁海昕, 孙唯哲, 刘鑫, 陈德训, 叶跃进, 何香.
面向国产异构众核架构的CFD非结构网格计算并行优化方法
Parallel Optimization Method of Unstructured-grid Computing in CFD for DomesticHeterogeneous Many-core Architecture
计算机科学, 2022, 49(6): 99-107. https://doi.org/10.11896/jsjkx.210400157
[2] 傅天豪, 田鸿运, 金煜阳, 杨章, 翟季冬, 武林平, 徐小文.
一种面向构件化并行应用程序的性能骨架分析方法
Performance Skeleton Analysis Method Towards Component-based Parallel Applications
计算机科学, 2021, 48(6): 1-9. https://doi.org/10.11896/jsjkx.201200115
[3] 何亚茹, 庞建民, 徐金龙, 朱雨, 陶小涵.
基于神威平台的Floyd并行算法的实现和优化
Implementation and Optimization of Floyd Parallel Algorithm Based on Sunway Platform
计算机科学, 2021, 48(6): 34-40. https://doi.org/10.11896/jsjkx.201100051
[4] 冯凯, 马鑫玉.
(n,k)-冒泡排序网络的子网络可靠性
Subnetwork Reliability of (n,k)-bubble-sort Networks
计算机科学, 2021, 48(4): 43-48. https://doi.org/10.11896/jsjkx.201100139
[5] 胡蓉, 阳王东, 王昊天, 罗辉章, 李肯立.
基于GPU加速的并行WMD算法
Parallel WMD Algorithm Based on GPU Acceleration
计算机科学, 2021, 48(12): 24-28. https://doi.org/10.11896/jsjkx.210600213
[6] 马梦宇, 吴烨, 陈荦, 伍江江, 李军, 景宁.
显示导向型的大规模地理矢量实时可视化技术
Display-oriented Data Visualization Technique for Large-scale Geographic Vector Data
计算机科学, 2020, 47(9): 117-122. https://doi.org/10.11896/jsjkx.190800121
[7] 陈国良, 张玉杰.
并行计算学科发展历程
Development of Parallel Computing Subject
计算机科学, 2020, 47(8): 1-4. https://doi.org/10.11896/jsjkx.200600027
[8] 阳王东, 王昊天, 张宇峰, 林圣乐, 蔡沁耘.
异构混合并行计算综述
Survey of Heterogeneous Hybrid Parallel Computing
计算机科学, 2020, 47(8): 5-16. https://doi.org/10.11896/jsjkx.200600045
[9] 冯凯, 李婧.
k元n方体的子网络可靠性研究
Study on Subnetwork Reliability of k-ary n-cubes
计算机科学, 2020, 47(7): 31-36. https://doi.org/10.11896/jsjkx.190700170
[10] 杨宗霖, 李天瑞, 刘胜久, 殷成凤, 贾真, 珠杰.
基于Spark Streaming的流式并行文本校对
Streaming Parallel Text Proofreading Based on Spark Streaming
计算机科学, 2020, 47(4): 36-41. https://doi.org/10.11896/jsjkx.190300070
[11] 邓定胜.
一种改进的DBSCAN算法在Spark平台上的应用
Application of Improved DBSCAN Algorithm on Spark Platform
计算机科学, 2020, 47(11A): 425-429. https://doi.org/10.11896/jsjkx.190700071
[12] 徐传福,王曦,刘舒,陈世钊,林玉.
基于Python的大规模高性能LBM多相流模拟
Large-scale High-performance Lattice Boltzmann Multi-phase Flow Simulations Based on Python
计算机科学, 2020, 47(1): 17-23. https://doi.org/10.11896/jsjkx.190500009
[13] 舒娜,刘波,林伟伟,李鹏飞.
分布式机器学习平台与算法综述
Survey of Distributed Machine Learning Platforms and Algorithms
计算机科学, 2019, 46(3): 9-18. https://doi.org/10.11896/j.issn.1002-137X.2019.03.002
[14] 李炎, 马俊明, 安博, 曹东刚.
一个基于Web的轻量级大数据处理与可视化工具
Web Based Lightweight Tool for Big Data Processing and Visualization
计算机科学, 2018, 45(9): 60-64. https://doi.org/10.11896/j.issn.1002-137X.2018.09.008
[15] 张滨, 乐嘉锦.
基于列存储的MapReduce分布式Hash连接算法
Hash Join in MapReduce Distributed Environment Based on Column-store
计算机科学, 2018, 45(6A): 471-475.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!