›› 2016, Vol. 37 ›› Issue (11): 3309-3316.doi: 10.16285/j.rsm.2016.11.033

• 数值分析 • 上一篇    下一篇

岩土工程亿级单元有限元模型可扩展并行计算

张友良,谭 飞,张礼仁,施明明   

  1. 中国科学院武汉岩土力学研究所 岩土力学与工程国家重点实验室,湖北 武汉 430071
  • 收稿日期:2014-12-20 出版日期:2016-11-11 发布日期:2018-06-09
  • 作者简介:张友良,男,1972年生,博士,研究员,博士生导师,主要从事岩土工程高性能数值模拟、边坡工程和地下工程等方面研究工作。
  • 基金资助:

    国家重点基础研究发展计划(973 计划)(No. 2014CB047100);国家自然科学基金(No. 11272330);中科院“十二五”信息化专项(No. XXH12503-02-02-11)。

Scalable parallel computation for finite element model with hundreds of millions of elements in geotechnical engineering

ZHANG You-liang, TAN Fei, ZHANG Li-ren, SHI Ming-ming   

  1. State Key Laboratory of Geomechanics and Geotechnical Engineering, Institute of Rock and Soil Mechanics, Chinese Academy of Sciences, Wuhan, Hubei 430071, China
  • Received:2014-12-20 Online:2016-11-11 Published:2018-06-09
  • Supported by:

    This work was supported by the National Basic Research Program of China (973 Program) (2014CB047100), the National Nature Science Foundation of China(11272330)and the 12th Five-year plan of Chinese Academy of Sciences for Informatization (XXH12503-02-02-11).

摘要: 讨论了亿万单元有限元模型的可扩展并行计算方法。从软件和硬件两个方面提出了前处理、并行计算方法、程序算法、后处理实现等核心问题的解决方案。采用网格加密方法生成一亿单元的有限元模型,利用对偶原始有限元撕裂内联法(FETI-DP)求解系统方程。基于图论理论建立了子区域间的通讯拓扑关系,实现了子区域间点对点通讯,避免速度慢、通信量大的全局通讯。在自主开发程序基础上,增加相应模块,采用面向对象编程技术和MPI消息传递库开发程序。对一个一亿多单元的工程实例运用5 000核并行计算,得到了超线性加速比。计算结果在专用图形工作站上进行后处理,显示和交互操作速度良好。研究在两方面实现了突破:一是将模型规模提高到了一亿多单元;二是同时调用了5 000个计算核来并行运算,并得到了很高效率。高分辨率有限元并行模拟研究成果可为岩土工程中结构特别复杂、计算区域特别大、地质情况复杂等模拟提供很好的技术方法和实现手段。

关键词: 并行有限元, 可扩展并行计算, 岩土工程, 对偶原始有限元撕裂内联法(FETI-DP)

Abstract: The scalable parallel computation of finite element models with hundreds of millions of elements is discussed. The software and hardware solutions for the preprocessing, parallel computing method, software algorithms, and postprocessing are proposed. A finite element model of one hundred million elements is generated by grid encryption method. And the dual-primal finite element tearing and interconnecting method (FETI-DP) is utilized to solve the finite element system of equations. The topological connections among sub-domains are set up based on graph theories. Point to point communications are built to accelerate data exchange among sub-domains and to avoid the time-consuming global communications. Some modules are written based on an in-house code using object-oriented programming technique and message passing interface (MPI). A numerical example with more than one hundred million number of elements is carried out using 5000 cores at the same time; and super-linear speedup is obtained. The postprocessing is performed on a graphical workstation; and the interactive operations respond quickly. The study shows two big improvements: one is that the numerical model has more than one hundred million numbers of elements; the second is that 5 000 cores are used at the same time and high efficiency is obtained. The research results show that the high resolution numerical simulations provide an efficient tool for large size and complex geological conditions simulations in geotechnical engineering.

Key words: parallel finite elements, scalable parallel computation, geotechnical engineering, dual-primal finite element tearing and interconnecting method (FETI-DP)

中图分类号: 

  • O 242.21

[1] 何静斌, 冯忠居, 董芸秀, 胡海波, 刘 闯, 郭穗柱, 张聪, 武敏, 王振, . 强震区桩−土−断层耦合作用下桩基动力响应[J]. 岩土力学, 2020, 41(7): 2389-2400.
[2] 师旭超, 孙运德. 线性卸荷作用下软土超孔隙水压力 变化规律分析[J]. 岩土力学, 2020, 41(4): 1333-1338.
[3] 田威, 王震, 张丽, 余宸, . 高温作用后3D打印岩体试样力学性能初探[J]. 岩土力学, 2020, 41(3): 961-969.
[4] 赵强, 焦玉勇, 张秀丽, 谢壁婷, 王龙, 黄刚海, . 基于显式时间积分的球颗粒DDA计算方法[J]. 岩土力学, 2019, 40(11): 4515-4522.
[5] 范文亮,王余乐,魏奇科,杨朋超,李正良, . 岩土工程可靠度分析的改进四阶矩方法[J]. , 2018, 39(4): 1463-1468.
[6] 黄明华,赵明华,陈昌富. 锚固长度对锚杆受力影响分析及其临界值计算[J]. , 2018, 39(11): 4033-4041.
[7] 熊自明,卢 浩,王明洋,钱七虎,戎晓力,. 我国大型岩土工程施工安全风险管理研究进展[J]. , 2018, 39(10): 3703-3716.
[8] 方砚兵,苏永华,肖 旺,梁 斌. 基于子区间法的隐式功能函数非概率可靠性方法研究[J]. , 2017, 38(4): 1171-1178.
[9] 闫澍旺,林 澍,霍知亮,楚 剑,郭 伟,. 桶形基础液压下沉过程的耦合欧拉-拉格朗日有限元法分析[J]. , 2017, 38(1): 247-252.
[10] 付晓东,盛 谦,张勇慧,冷先伦, . 非连续变形分析(DDA)线性方程组的高效求解算法[J]. , 2016, 37(4): 1171-1178.
[11] 张 蕾 ,唐小松 ,李典庆 ,曹子君 , . 基于Copula函数的岩土结构物系统可靠度分析[J]. , 2016, 37(1): 193-202.
[12] 董威信,王翔南,王 远,于玉贞. 三维过渡等参单元在岩土工程有限元分析中的应用[J]. , 2015, 36(5): 1455-1462.
[13] 王 浩 ,覃卫民 ,焦玉勇 ,何 政,. 大数据时代的岩土工程监测——转折与机遇[J]. , 2014, 35(9): 2634-2641.
[14] 付晓东,盛 谦,张勇慧. 基于OpenMP的非连续变形分析并行计算方法[J]. , 2014, 35(8): 2401-2407.
[15] 沈 辉 ,罗先启 ,郑安兴 ,毕金锋 ,翁永红,. 拱坝联合坝肩岩体三维计算模型构建[J]. , 2014, 35(5): 1455-1460.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!