ExaFSA: Parallel Fluid-Structure-Acoustic Simulation

Lindner, Florian; Totounferoush, Amin; Mehl, Miriam; Uekérmann, Benjamin; Pour, Neda Ebrahimi; Krupp, Verena; Roller, Sabine; Reimann, Thorsten; Sternel, Dörte C.; Egawa, Ryusuke; Takizawa, Hiroyuki; Simonis, F.

doi:10.1007/978-3-030-47956-5_10

“…It comes with adapter codes for popular simulation software and a high-level interface for many popular programming languages. Additionally, it has been optimized for high computational efficiency by implementing several acceleration methods, including a number of interface quasi-Newton methods [41], parallel data communication [29,31], and sophisticated data mapping techniques including radial basis function mapping [29,30] for the use with non-matching grids. This sets preCICE apart from commercial or closed sourced alternatives such as MpCCI 1 [23], where one cannot access or change the implementation.…”

Section: Introductionmentioning

confidence: 99%

Simulation of flow in deformable fractures using a quasi-Newton based partitioned coupling approach

Schmidt

¹

,

Jaust

²

,

Steeb

³

et al. 2022

View full text Add to dashboard Cite

We introduce a partitioned coupling approach for iterative coupling of flow processes in deformable fractures embedded in a poro-elastic medium that is enhanced by interface quasi-Newton (IQN) methods. In this scope, a unique computational decomposition into a fracture flow and a poro-elastic domain is developed, where communication and numerical coupling of the individual solvers are realized by consulting the open-source library preCICE. The underlying physical problem is introduced by a brief derivation of the governing equations and interface conditions of fracture flow and poro-elastic domain followed by a detailed discussion of the partitioned coupling scheme. We evaluate the proposed implementation and undertake a convergence study to compare a classical interface quasi-Newton inverse least-squares (IQN-ILS) with the more advanced interface quasi-Newton inverse multi-vector Jacobian (IQN-IMVJ) method. These coupling approaches are verified for an academic test case before the generality of the proposed strategy is demonstrated by simulations of two complex fracture networks. In contrast to the development of specific solvers, we promote the simplicity and computational efficiency of the proposed partitioned coupling approach using preCICE and FEniCS for parallel computations of hydro-mechanical processes in complex, three-dimensional fracture networks.

show abstract

“…Lindner [12,13] already removed several initialization bottlenecks concerning the creation of communication channels, on the one hand, and neighborhood search between mesh partitions of two solvers, on the other hand. We briefly summarize both efforts in this and the following paragraph.…”

Section: Introductionmentioning

confidence: 99%

“…Figure13. Weak scalability measurements: Total initialization time comparison between the two-level and the one-level schemes.…”

mentioning

confidence: 99%

Efficient and Scalable Initialization of Partitioned Coupled Simulations with preCICE

Totounferoush

¹

,

Simonis

²

,

Uekérmann

³

et al. 2021

Self Cite

View full text Add to dashboard Cite

preCICE is an open-source library, that provides comprehensive functionality to couple independent parallelized solver codes to establish a partitioned multi-physics multi-code simulation environment. For data communication between the respective executables at runtime, it implements a peer-to-peer concept, which renders the computational cost of the coupling per time step negligible compared to the typical run time of the coupled codes. To initialize the peer-to-peer coupling, the mesh partitions of the respective solvers need to be compared to determine the point-to-point communication channels between the processes of both codes. This initialization effort can become a limiting factor, if we either reach memory limits or if we have to re-initialize communication relations in every time step. In this contribution, we remove two remaining bottlenecks: (i) We base the neighborhood search between mesh entities of two solvers on a tree data structure to avoid quadratic complexity, and (ii) we replace the sequential gather-scatter comparison of both mesh partitions by a two-level approach that first compares bounding boxes around mesh partitions in a sequential manner, subsequently establishes pairwise communication between processes of the two solvers, and finally compares mesh partitions between connected processes in parallel. We show, that the two-level initialization method is fives times faster than the old one-level scheme on 24,567 CPU-cores using a mesh with 628,898 vertices. In addition, the two-level scheme is able to handle much larger computational meshes, since the central mesh communication of the one-level scheme is replaced with a fully point-to-point mesh communication scheme.

show abstract

“…It comes with adapter codes for popular simulation software and a high-level interface for many popular programming languages. Additionally, it has been optimized for high computational efficiency by implementing several acceleration methods, including a number of interface quasi-Newton methods [38], parallel data communication [27,29], and sophisticated data mapping techniques including radial basis function mapping [27,28] for the use with non-matching grids. This sets preCICE apart from commercial or closed sourced alternatives such as MpCCI 1 [21], where one cannot access or change the implementation.…”

Section: Introductionmentioning

confidence: 99%

Simulation of flow in deformable fractures using a quasi-Newton based partitioned coupling approach

Schmidt,

Jaust,

Steeb

et al. 2021

Preprint

0

View full text Add to dashboard Cite

We introduce a partitioned coupling approach for iterative coupling of flow processes in deformable fractures embedded in a poro-elastic medium that is enhanced by interface quasi-Newton (IQN) methods. In this scope, a unique computational decomposition into a fracture flow and a poro-elastic domain is developed, where communication and numerical coupling of the individual solvers are realized by consulting the open-source library preCICE. The underlying physical problem is introduced by a brief derivation of the governing equations and interface conditions of fracture flow and poro-elastic domain followed by a detailed discussion of the partitioned coupling scheme. We evaluate the proposed implementation and undertake a convergence study to compare a classical interface quasi-Newton inverse least-squares (IQN-ILS) with the more advanced interface quasi-Newton inverse multi-vector Jacobian (IQN-IMVJ) method. These coupling approaches are verified for an academic test case before the generality of the proposed strategy is demonstrated by simulations of two complex fracture networks. In contrast to the development of specific solvers, we promote the simplicity and computational efficiency of the proposed partitioned coupling approach using preCICE and FEniCS for parallel computations of hydro-mechanical processes in complex, threedimensional fracture networks.

show abstract

ExaFSA: Parallel Fluid-Structure-Acoustic Simulation

Cited by 7 publications

References 33 publications

Simulation of flow in deformable fractures using a quasi-Newton based partitioned coupling approach

Simulation of flow in deformable fractures using a quasi-Newton based partitioned coupling approach

Efficient and Scalable Initialization of Partitioned Coupled Simulations with preCICE

Simulation of flow in deformable fractures using a quasi-Newton based partitioned coupling approach

Contact Info

Product

Resources

About