system modelling performance activities for earth 14/05/2018 performance activities for earth system...
TRANSCRIPT
![Page 1: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/1.jpg)
www.bsc.es 14/05/2018
Performance activities for Earth System Modelling
Earth Science Department (BSC)Computational Earth Science
Performance Team
Mario C. Acosta, Miguel Castrillo, Oriol Tintó, Xavier Yepes
![Page 2: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/2.jpg)
1
BSC Departments
![Page 3: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/3.jpg)
2
Earth Science Department
•
•
![Page 4: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/4.jpg)
3
Computational Earth Science
Performance Team• Provide HPC Services such as performance analysis or
optimizations for Earth System Models • Research on new computational methods
Models and Workflows Team• Development of HPC user-friendly software framework • Support the development of atmospheric research
software
Data and Diagnostics Team• Big Data in Earth Sciences• Provision of data services• Visualization
![Page 5: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/5.jpg)
4
High Performance Computing (Services and Research) applied to Earth System Modelling
● Knowledge about the mathematical and computational side of Earth System Applications
● Knowledge about the specific needs in HPC of the Earth System Applications
● Researching about HPC methods specifically used for Earth System Applications
High Performance Computing (Services and Research) applied to Earth System Modelling
Weather and Climate Science
Computer Science
![Page 6: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/6.jpg)
5
• Future H2020 projects and proposals where we work/will work– ESCAPE2 → Profiling analysis during benchmarking– MERCATOR → Profiling analysis and research in new
optimizations for NEMO– ESiWACE2 → EC-Earth 5km, HPC services for pre-exascale,
Efficient IFS/XIOS integration– IS-ENES3 → Co-leading HPC workpackage– COPERNICUS → Profiling analysis and research in new
optimizations for NEMO– HARMONIE-AROME → Profiling analysis and research in new
optimizations (Proposal to Hirlam advisory Committee)– XIOS → Profiling analysis and research in new optimizations
(Collaboration with XIOS Team, IPSL)
![Page 7: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/7.jpg)
6
Methodology
High Performance Computing (Services and Research) applied to Earth System Modelling
● Knowledge about the mathematical and computational side of Earth System Applications
● Knowledge about the specific needs in HPC of the Earth System Applications
● Researching about HPC methods specifically used for Earth System Applications
High Performance Computing (Services and Research) applied to Earth System Modelling
Weather and Climate Science
Computer Science
![Page 8: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/8.jpg)
7
Methodology
• Mathematical study
– Some methods could be better than others
• Discretization used (explicit, implicit,
semi-implicit…)
• Parallel adaptation (solvers, preconditioners…)
– How to implement new algorithms for new
architectures
• Computational study
– Achieve load balance among components
– Reduce overhead introduced by parallel
applications
– Assure that the computational algorithm takes
advantage of the architecture
![Page 9: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/9.jpg)
8
Methodology
•
Possible load balance of coupled components of a Earth System Model
![Page 10: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/10.jpg)
9
Methodology
•
![Page 11: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/11.jpg)
10
General Profiling: Study Area
![Page 12: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/12.jpg)
11
General Profiling
![Page 13: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/13.jpg)
12
General Profiling
- Parallel and Communication efficiency, Global load balance → less than 85%?
Parallel Efficiency
Communication EfficiencyGlobal Load Balance
IFS standalone
NEMO+Coupling
![Page 14: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/14.jpg)
13
Methodology
• Introducing optimizations
– Improvement of the mathematical and/or
computational algorithm
• Apply scientific methods which are found in the
literature
• Improve the method with a new approach
– Revolution: Create a new (and better)
algorithm taking into account the research line
followed
![Page 15: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/15.jpg)
14
Methodology
• Reproducibility study
– Evaluate if the accuracy and reproducibility of the model is similar
using or not the optimizations proposed
– Take into account the nature of climate models
• How to evaluate, in parallel executions, if the differences
between runs are significant or not.
![Page 16: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/16.jpg)
![Page 17: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/17.jpg)
16
![Page 18: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/18.jpg)
17
• IFSCY43R3, T1259,
•••
••••
![Page 19: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/19.jpg)
18
![Page 20: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/20.jpg)
19
•••
![Page 21: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/21.jpg)
20
![Page 22: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/22.jpg)
21
•
•
![Page 23: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/23.jpg)
22
•
•
![Page 24: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/24.jpg)
23
•
•
![Page 25: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/25.jpg)
24
•
•
![Page 26: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/26.jpg)
25
•
Outputs 1st time step 2nd time step 3rd time step
IFS
MF I/O Server
![Page 27: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/27.jpg)
26
![Page 28: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/28.jpg)
27
![Page 29: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/29.jpg)
28
•
• →
••
••
•
••
![Page 30: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/30.jpg)
www.bsc.es
Thank you!
![Page 31: System Modelling Performance activities for Earth 14/05/2018 Performance activities for Earth System Modelling Earth Science Department (BSC) Computational Earth Science Performance](https://reader036.vdocuments.site/reader036/viewer/2022062508/604edc1f99cf18755f2971c3/html5/thumbnails/31.jpg)
30