2023-10-23 AI Training Series - Intro to Container Technology & Application to AI at LRZ (hdta2w23)

CourseAI Training Series - Intro to Container Technology & Application to AI at LRZ
Numberhdta2w23
Available places88
Date23.10.2023 – 23.10.2023
PriceEUR 0.00
LocationHYBRID: ONLINE/LRZ
Boltzmannstr. 1
85748 Garching near Munich
RoomKursraum 2
Registration deadline13.10.2023 23:59
E-maileducation@lrz.de


This course is part of the "LRZ AI Training Series", a series of courses aiming at the needs and expectations of data analytics, big data & AI users at LRZ. While focusing on these particular users and their use cases, this session as well as all other courses offered as part of the AI Training Series are, of course, open to all interested parties.

This course for academic participants from Germany will be organised as a hybrid event with the possibility to attend at LRZ in Garching near Munich or online. On-site participation will allow for direct interaction with trainers during hands-on and demos. When registering, you can choose between 2 booking options:

- Academia Germany ONLINE: If you want to attend remotely.
- Academia Germany ON-SITE: If you want to attend at LRZ in Garching near Munich.

On-site participants are expected to bring their own laptops.

Contents

Since the introduction of docker back in 2013, container technology has become the industry standard for software packaging, distribution, and deployment.
Creating a container consists in bundling an application, its dependencies and runtime in a single unit that can later run independently of the underlying infrastructure. Unlike virtual machines, containers are lightweight and yield higher performances while providing greater versatility and interoperability. As containers accommodate an easy, safe, reliable, and scalable way to run applications and pipelines, they are an attractive candidate for high performance computing and artificial intelligence workloads.
With this module, we will showcase the most enticing features and niceties offered by containers. Not only will we explore their history and implementations, but we will also dive into actual and cutting edge uses with a particular emphasis on artificial intelligence tasks, reproducible biomedical pipelines, and automated workflows.
Participants will roll up their sleeves and get their hands on the compute cloud of LRZ to set containers in action. By the end of the course, participants will be able to transfer their experience and knowledge to their specific use-cases and requirements.

Three content blocks of roughly one hour each:

1 A Tour of Containers and Kickstart
    1.1 You Are Here
    1.2 Basic Concepts for Containers
    1.3 Containers vs. the World
    1.4 Kickstarter: Your First Steps With Containers
2 Under the Hood of Containers: Warm-up Lap to Flat-out
    2.1 The Bolts and Nuts of Containers
        2.1.1 Namespaces, cgroups, and copy-on-write Storage
        2.1.2 Volumes, Networking, and More
        2.1.3 Configuration and Image Creation
    2.2 Warm-up lap: Make an ANN  Dream in a Container
    2.3 Containers and Security
        2.3.1 Security and User Namespace
        2.3.2 Security and Docker Socket Exploit
    2.4 Containers and HPC
    2.5 Flat-out: Containers and HPC With enroot and Charliecloud
3 Containers on Nitromethane
    3.1 Abstract Your Containers
        3.1.1 Continuous Integration / Continuous Deployment
        3.1.2 Reproducible Scientific Pipelines
    3.2 Hardware Accelerated Containers
    3.3 Orchestration and Scaling Across a Compute Cluster
    3.4 Last Lap: Reproducible Transcriptomic Workflow With Containers and Nextflow

End: Wrap-up, take home message, last questions and book / website / podcast / events recommendations

Prerequisites

  •  AI Training Series: Orientation Session (or comparable previous knowledge): access the remote work environment, navigate the work environment, edit files, pull images, spin containers...

Hands-On

  • Hands-on #1: Your first steps with containers
  • Hands-on #2: Make an artificial neural network dream in a container
  • Hands-on #3: Container and HPC with Charliecloud 
  • Hands-on #4: Enable transcriptomic reproducible workflow with con- tainers and Nextflow

Content Level

The content level of the course is broken down as:

Beginner's content:

2:20h

52%

Intermediate content:

1:45h

39%

Advanced content:

0:25h

9%

Community-targeted content:

0,0h

0%

Language

English

Lecturers

Florent Dufour (LRZ)

Prices and Eligibility

The course is open and free of charge for academic participants from Germany.

Registration

Please register with your official e-mail address to prove your affiliation.You can select the course modules you wish to attend during registration.

Withdrawal Policy

See Withdrawal

Legal Notices

For registration for LRZ courses and workshops we use the service edoobox from Etzensperger Informatik AG (www.edoobox.com). Etzensperger Informatik AG acts as processor and we have concluded a Data Processing Agreement with them.

See Legal Notices


No.

Date

Time

Leader

Location

Room

Description

123.10.202310:00 – 16:00Johannes Albert-von der Gönna
Florent Dufour
LRZ Events
HYBRID: ONLINE/LRZKursraum 2Lecture