Cheng Tangpei, Mo Zeyao, Shao Jingli
Key Laboratory of Computational Physics, Institute of Applied Physics and Computational Mathematics, Beijing 100088, China.; High Performance Computing Center, Institute of Applied Physics and Computational Mathematics, Beijing 100094, China.
Ground Water. 2014 Mar-Apr;52(2):194-205. doi: 10.1111/gwat.12047. Epub 2013 Apr 18.
To accelerate the groundwater flow simulation process, this paper reports our work on developing an efficient parallel simulator through rebuilding the well-known software MODFLOW on JASMIN (J Adaptive Structured Meshes applications Infrastructure). The rebuilding process is achieved by designing patch-based data structure and parallel algorithms as well as adding slight modifications to the compute flow and subroutines in MODFLOW. Both the memory requirements and computing efforts are distributed among all processors; and to reduce communication cost, data transfers are batched and conveniently handled by adding ghost nodes to each patch. To further improve performance, constant-head/inactive cells are tagged and neglected during the linear solving process and an efficient load balancing strategy is presented. The accuracy and efficiency are demonstrated through modeling three scenarios: The first application is a field flow problem located at Yanming Lake in China to help design reasonable quantity of groundwater exploitation. Desirable numerical accuracy and significant performance enhancement are obtained. Typically, the tagged program with load balancing strategy running on 40 cores is six times faster than the fastest MICCG-based MODFLOW program. The second test is simulating flow in a highly heterogeneous aquifer. The AMG-based JASMIN program running on 40 cores is nine times faster than the GMG-based MODFLOW program. The third test is a simplified transient flow problem with the order of tens of millions of cells to examine the scalability. Compared to 32 cores, parallel efficiency of 77 and 68% are obtained on 512 and 1024 cores, respectively, which indicates impressive scalability.
为了加速地下水流模拟过程,本文报告了我们通过在JASMIN(J自适应结构化网格应用基础设施)上重新构建著名软件MODFLOW来开发高效并行模拟器的工作。重建过程是通过设计基于补丁的数据结构和并行算法,以及对MODFLOW中的计算流程和子程序进行轻微修改来实现的。内存需求和计算工作量都分布在所有处理器之间;为了降低通信成本,数据传输被分批处理,并通过为每个补丁添加虚节点来方便地进行处理。为了进一步提高性能,在线性求解过程中对定水头/非活动单元格进行标记并忽略,并提出了一种有效的负载平衡策略。通过对三种情况进行建模来证明其准确性和效率:第一个应用是位于中国雁鸣湖的现场水流问题,以帮助设计合理的地下水开采量。获得了理想的数值精度和显著的性能提升。通常,在40个核心上运行的带有负载平衡策略的标记程序比最快的基于MICCG的MODFLOW程序快六倍。第二个测试是模拟高度非均质含水层中的水流。在40个核心上运行的基于AMG的JASMIN程序比基于GMG的MODFLOW程序快九倍。第三个测试是一个具有数千万个单元格规模的简化瞬态水流问题,以检验其可扩展性。与32个核心相比,在512个和1024个核心上分别获得了77%和68%的并行效率,这表明其具有令人印象深刻的可扩展性。