EGU General Assembly 2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.

Optimizations of Multiscale Simulation with AGRIF, towards Exascale Applications

Gaston Irrmann1,2,3, Sebastien Masson1, Laurent Debreu3, David Guibert2, and Erwan Raffin2
Gaston Irrmann et al.
  • 1Sorbonne, IPSL, UMR7159, France (
  • 2CEPP - Center for Excellence in Performance Programming, Atos, 35700 Rennes, France
  • 3Centre de recherche Inria Grenoble Rhône-Alpes Inovallée, 38334 Montbonnot,France

AGRIF (Adaptive Grid Refinement In Fortran) is a package for the integration of full adaptive mesh refinement features within a multidimensional finite difference model. This library is used in ocean models like NEMO (Nucleus for European Modelling of the Ocean) to offer the possibility to run multiple levels and 2-way nested embedded zooms. Within the ESiWACE2 project, AGRIF performance have been addressed toward high resolution simulations. 
First, a simple AGRIF configuration within NEMO has been set up to simplify benchmarking, profiling and testing new optimizations ideas. We selected on purpose a configuration with small MPI sudomains to mimic simulations running on high numbers of core. Second, a profiling analysis has let us identify an important overhead. Indeed, on a zoom with a refinement of a factor 3 in both latitude and longitude covering 1/9 of the simulated domain an overhead of 46% has been observed compared with the theoretical performance. The correction of land points used in the interpolation on the zoom has been found to be a major bottlenecks. Third, we implemented an optimization concerning the correction on land point limiting as much as possible the computations and taking advantage of the specificity of each interpolation. This adjustment provided us with a reduction of 25% of the time to solution in the aforementioned configuration. For future work, we identified numerous optimizations including further optimizations of the correction of land points.

How to cite: Irrmann, G., Masson, S., Debreu, L., Guibert, D., and Raffin, E.: Optimizations of Multiscale Simulation with AGRIF, towards Exascale Applications, EGU General Assembly 2022, Vienna, Austria, 23–27 May 2022, EGU22-12292,, 2022.