Performance Assessment of Hybrid Parallelism for Large-Scale Reservoir Simulation on Multi- and Many-core Architectures

Amani AlOnazi, Marcin Rogowski, Ahmed Al-Zawawi, David E. Keyes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations


Two trends are reshaping the landscape of petroleum reservoir simulators, one architecturally and one application driven: an increasing number of cores per node and increasing computational intensity arising from higher fidelity physics at each cell. Implicit algebraic solvers being the dominant kernels, we present hybrid MPI and OpenMP implementations of the linear solver of GigaPOWERS, a full-scale real-world massively parallel simulator for black oil and composition models. We also evaluate the impact of explicit communication and computation overlap by including the halo exchange in the task-dependency graph. We analyze the performance of these modifications across multi- and many-core architectures, i.e., Intel Haswell, Skylake, and Knights Landing, using a variety of synthetic and real-world models. The hybrid approach results in up to 50% reduction of time to solution on a 16 million-cell SPE10-like model on Skylake whereas on a smaller, 1 million-cell, model on Haswell and Knights Landing both implementations achieve very similar performance. In the real-world reservoir simulations, the hybrid parallelism has reduced communication volume, memory consumption, and improved load balancing.
Original languageEnglish (US)
Title of host publication2018 IEEE High Performance extreme Computing Conference (HPEC)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
ISBN (Print)9781538659892
StatePublished - Dec 8 2018

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01


Dive into the research topics of 'Performance Assessment of Hybrid Parallelism for Large-Scale Reservoir Simulation on Multi- and Many-core Architectures'. Together they form a unique fingerprint.

Cite this