DLI Training Series @ LRZ 2024

DLI Training Series - Fundamentals of Deep Learning

Agenda

  • 10:00 - 11:20 An Introduction to Deep Learning
  • 11:20 - 11:40 Coffee Break
  • 11:40 - 13:00 How a Neural Network Trains & Convolutional Neural Networks
  • 13:30 - 14:00 Lunch Break 
  • 14:00 - 15:20 Data Augmentation, Deployment, and Pre-trained models
  • 15:20 - 15:40 Coffee Break
  • 15:40 - 16:45 Advanced Architectures
  • 16:45 - 17:00 Wrap up and Q&A 

Slides

Survey

  • Please fill out the online survey under https://survey.lrz.de/index.php/887439?lang=en
  • This helps us to
    • increase the quality of the courses,
    • design the future training programme at LRZ and GCS according to your needs and wishes,
    • get future funding for training events.

DLI Training Series - Applications of AI for Anomaly Detection

Agenda

  • 10:00 - 11:20 Introduction to Anomaly Detection 
  • 11:20 - 11:40 Coffee Break
  • 11:40 - 13:00 Anomaly Detection with XGBoost 
  • 13:30 - 14:00 Lunch Break 
  • 14:00 - 15:20 Anomaly Detection with Auto encoders
  • 15:20 - 15:40 Coffee Break
  • 15:40 - 16:45 Anomaly Detection with GANs
  • 16:45 - 17:00 Wrap up and Q&A 

Slides

Survey

  • Please fill out the online survey under https://survey.lrz.de/index.php/841192?lang=en
  • This helps us to
    • increase the quality of the courses,
    • design the future training programme at LRZ and GCS according to your needs and wishes,
    • get future funding for training events.

DLI Training Series - Building Transformer-Based Natural Language Processing Applications

Agenda

  • 10:00 - 11:20 Machine Learning in NLP
  • 11:20 - 11:40 Coffee Break
  • 11:40 - 13:00 BERT Hands On Jupyter Notebook
  • 13:30 - 14:00 Lunch Break 
  • 14:00 - 15:20 Self-supervision, BERT and Beyond
  • 15:20 - 15:40 Coffee Break
  • 15:40 - 16:45 Production Deployment
  • 16:45 - 17:00 Wrap up and Q&A 

Slides


Survey

  • Please fill out the online survey under https://survey.lrz.de/index.php/699342?lang=en
  • This helps us to
    • increase the quality of the courses,
    • design the future training programme at LRZ and GCS according to your needs and wishes,
    • get future funding for training events.



DLI Training Series - Data Parallelism - How to Train Deep Learning Models on Multiple GPUs

Agenda

  • 10:00-11:20   Neural Network Training and Stochastic Gradient Descent 
  • 11:20-11:40   Coffee Break
  • 11:40-13:00   Neural Network Training and Intro to Parallel Training
  • 13:00-14:00  Lunch Break
  • 14:00-15:20  Data Parallelism using Pytorch Distributed Data Parallel
  • 15:20-15:40  Coffee break
  • 15:40-16:45  Challenges of Data Parallel using Multiple GPUs
  • 16:45-17:00  Wrap up and Q&A 

Slides

Survey

  • Please fill out the online survey under https://survey.lrz.de/index.php/848953?lang=en
  • This helps us to
    • increase the quality of the courses,
    • design the future training programme at LRZ and GCS according to your needs and wishes,
    • get future funding for training events.

DLI Training Series - Model Parallelism - Building and Deploying Large Neural Networks

tbd.

Lecturer

PD Dr. Juan Durillo Barrionuevo (LRZ, NVIDIA certified University Ambassador)

NVIDIA Deep Learning Institute

The NVIDIA Deep Learning Institute delivers hands-on training for developers, data scientists, and engineers. The program is designed to help you get started with training, optimizing, and deploying neural networks to solve real-world problems across diverse industries such as self-driving cars, healthcare, online services, and robotics.

Training Setup

To get started, follow these steps:

  1. Create an NVIDIA Developer account at http://courses.nvidia.com/join Select "Log in with my NVIDIA Account" and then '"Create Account".
  2.  Make sure that WebSockets works for you:
    • Test your Laptop at http://websocketstest.com
    • Under ENVIRONMENT, confirm that '"WebSockets" is checked yes.
    • Under WEBSOCKETS (PORT 80]. confirm that "Data Receive", "Send", and "Echo Test" are checked yes.
  3. lf there are issues with WebSockets, try updating your browser.
  4. Visit http://courses.nvidia.com/dli-event and enter the event code provided by the instructor.
  5. You're ready to get started. Please complete the survey at the end of the course to share your feedback.

Next Steps

Visit the NVIDIA Deep Learning lnstitute's website at https://www.nvidia.com/en-us/training/ to access more training and resources.

  • Start online, self-paced training in deep learning and accelerated computing (using the account you created today).
  • View upcoming workshops around the world and request an onsite workshop at your company or organization.
  • Learn about the University Ambassador Program.