ALCF AI Testbed: Groq AI Training Workshop

America/Chicago
Murali Emani (LCF), Venkatram Vishwanath (LCF)
Description

This virtual training workshop will introduce users to the GroqRack system deployed at the ALCF AI Testbed. This workshop targets researchers at universities, national labs, and industries working on open science. 

The training session will introduce users to the architecture and the software stack. It will provide hands-on training to get started on the GroqRack in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available. 

NOTE: Please register and sign-up/reactivate your ALCF Account by 05/01 if you would like to participate in the hands-on session. 

Day 1 will focus on GroqRack hardware and software architecture, GroqFlow and running models on this system at the ALCF AI Testbed.

Day 2 will focus on a deep dive into large language models, the MLAgility tool, a hands-on session, and best practices. 

To Access ALCF machines please see the instructions below. Deadline to complete the following is 5/01:

  • New Users: Request an ALCF Computer User Account if you do not currently have one. Specify "aitestbed_training" as the project name.
  • Previous Users: If you have an ALCF Account that is currently inactive, submit an account reactivation request. Specify "aitestbed_training" as the project name.
  • Current Users: If you have an active ALCF account, click Join Project to submit a membership request for the project "aitestbed_training".
Registration
Participants
    • 1:00 PM 1:05 PM
      Intro to ALCF AI Testbed 5m
    • 1:05 PM 1:10 PM
      Welcome to Groq 5m
    • 1:10 PM 1:55 PM
      Groq Language Processing Unit (LPU)™ Architecture 45m
    • 1:55 PM 2:25 PM
      Accessing GroqRack™ at ALCF AI Testbed 30m
    • 2:25 PM 2:40 PM
      Break 15m
    • 2:40 PM 3:25 PM
      Porting Models with GroqFlow™ 45m
    • 3:25 PM 4:10 PM
      Benchmarking Models with MLAgility™ 45m
    • 1:00 PM 1:20 PM
      Groq Compiler™ Overview 20m
    • 1:20 PM 1:40 PM
      Groq Runtime™ Overview 20m
    • 1:40 PM 2:00 PM
      LLMs with Groq 20m
    • 2:00 PM 2:15 PM
      Break 15m
    • 2:15 PM 3:15 PM
      Throughput Optimization 1h
    • 3:15 PM 3:45 PM
      Whats Next 30m