2025-06-17 EuroCC2 Multi-GPU Programming Bootcamp (hbcp3s25)

Registration

Please apply via  registration page with your official email address to prove your affiliation.
The final participants will be selected after the registration deadline has passed and informed on 2 June.

Contents

The Multi-GPU Programming Bootcamp will be hosted virtually for one and a half days on June 17-18. Scaling applications to multiple GPUs across multiple nodes requires one to be adept at not just the programming models and optimization techniques, but also at performing root-cause analysis using in-depth profiling to identify and minimize bottlenecks. In this Bootcamp, participants will learn to improve the performance of an application step-by-step, taking cues from profilers along with the ways.

This bootcamp is co-organized by the Vienna Scientific Cluster (VSC), IT4Innovations National Supercomputing Center (IT4I), High-Performance Computing Center Stuttgart (HLRS), Jülich Supercomputing Centre (JSC), Leibniz Supercomputing Centre (LRZ), University of Donja Gorica (UDG), Academic Computer Centre Cyfronet AGH (Cyfronet), Linköping University (LiU), Research Institutes of Sweden (RISE), HPC Vega at IZUM (IZUM), OpenACC organization, and NVIDIA for EuroCC Austria, EuroCC Czechia, EuroCC@GCS, EuroCC Montenegro, EuroCC Poland, EuroCC Sweden, and EuroCC Slovenia, all National Competence Centres for High-Performance Computing.

Important Dates

19 May 2025 – Registration Deadline
2 June 2025 – Notification about Acceptance
16 June 2025, 14:00 – 15:00 (CEST) – Cluster Dry Run
17 June 2025, 09:00 – 15:00 (CEST) – Day 1
18 June 2025, 09:00 – 13:30 (CEST) – Day 2

Event Format

This one and a half day bootcamp will be hosted online in the Central European Summer Time (CEST) zone. All communication will be done through Zoom, Slack and email.

Prerequisites

• Experience with C/C++, NVIDIA CUDA®, MPI

Hands-On

Attendees will be given access to an A100 GPU on one of the organizers' supercomputers.

Daily Agenda (Subject to Change):

All times are in Central European Summer Time (CEST).

Cluster Dry Run: Monday June 16, 2025: 14:00 - 15:00

Day 1 Tuesday June 17, 2025: 09:00 - 15:00

• 09:00 - 09:05: Welcome to the EuroCC2 Bootcamp (Moderator)
• 09:05 - 09:30: Introduction to Nsight Systems and GPU Computing (Lecture and Read-only Lab)
• 09:30 - 10:30: Overview of a Single GPU Code
• 10:30 - 12:30: Parallelizing a Single GPU Code using CUDA memcpy, Streams, and an Introduction to Single Node Multi-GPU (P2P) (Lecture and Lab)
• 12:30 - 13:00: Lunch Break
• 13:00 - 15:00: Introduction to Multi-Node Multi-GPU (GPU Direct ) programming (Lecture and Lab)

Day 2 Wednesday June 18, 2025: 09:00 - 13:30

• 09:00 - 11:00: Introduction to NVIDIA Collectives Communications Library (NCCL) (Lecture and Lab)
• 11:00 - 13:00: Introduction to NVSHMEM (Lecture and Lab)
• 13:00 - 13:30: Demo of the Nsight Systems Profiler Report for a Multi-Node Application

Language

English

Lecturers / Training Assistants

Lecturer: Paul Graham (Nvidia)

Teaching assistants and cluster support from the participating HPC centres.

Prices and Eligibility

The course is open and free of charge for participants from academia, public administration and industry from the Member States (MS) of the European Union (EU) and Associated Countries to the Horizon 2020 programme. Please make sure to register with your official email address to prove your affiliation.

Legal Notices

This course is offered in cooperation by Vienna Scientific Cluster (VSC), IT4Innovations National Supercomputing Center (IT4I), High-Performance Computing Center Stuttgart (HLRS), Jülich Supercomputing Centre (JSC), Leibniz Supercomputing Centre (LRZ), University of Donja Gorica (UDG), Academic Computer Centre Cyfronet AGH (Cyfronet), Linköping University (LiU), Research Institutes of Sweden (RISE), HPC Vega at IZUM (IZUM), OpenACC organization, and NVIDIA. Registration is done via  handled by EuroCC Poland.

Acknowledgements

EuroCC 2 has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101101903. The JU receives support from the European Union’s Digital Europe Programme and Germany, Bulgaria, Austria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Greece, Hungary, Ireland, Italy, Lithuania, Latvia, Poland, Portugal, Romania, Slovenia, Spain, Sweden, France, Netherlands, Belgium, Luxembourg, Slovakia, Norway, Türkiye, Republic of North Macedonia, Iceland, Montenegro, Serbia.