ALCF AI Testbed: Groq AI Training Workshop

America/Chicago
Murali Emani (LCF) , Venkatram Vishwanath (LCF)
Description

This virtual training workshop will introduce users to the GroqRack system deployed at the ALCF AI Testbed. This workshop targets researchers at universities, national labs, and industries working on open science. 

The training session will introduce users to the architecture and the software stack. It will provide hands-on training to get started on the GroqRack in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available. 

NOTE: Please register and sign-up/reactivate your ALCF Account by 05/01 if you would like to participate in the hands-on session. 

Day 1 will focus on GroqRack hardware and software architecture, GroqFlow and running models on this system at the ALCF AI Testbed.

Day 2 will focus on a deep dive into large language models, the MLAgility tool, a hands-on session, and best practices. 

To Access ALCF machines please see the instructions below. Deadline to complete the following is 5/01:

  • New Users: Request an ALCF Computer User Account if you do not currently have one. Specify "aitestbed_training" as the project name.
  • Previous Users: If you have an ALCF Account that is currently inactive, submit an account reactivation request. Specify "aitestbed_training" as the project name.
  • Current Users: If you have an active ALCF account, click Join Project to submit a membership request for the project "aitestbed_training".
Registration
Participants
    • 1:00 PM 1:05 PM
      Intro to ALCF AI Testbed 5m
    • 1:05 PM 1:35 PM
      Groq Language Processing Unit™ (LPU) Architecture 30m
    • 1:35 PM 1:45 PM
      Intro to MLAgility™ and GroqFlow™ 10m
    • 1:45 PM 2:30 PM
      Porting Models with GroqFlow™ 45m
    • 2:30 PM 2:45 PM
      Break 15m
    • 2:45 PM 3:30 PM
      Benchmarking Models with MLAgility™ 45m
    • 3:30 PM 4:15 PM
      Accessing GroqRack™ at ALCF AI Testbed 45m
  • Wednesday, 5 June
    • 1:00 PM 1:20 PM
      Groq Compiler™ Overview 20m
    • 1:20 PM 1:40 PM
      Groq Runtime™ Overview 20m
    • 1:40 PM 2:30 PM
      Large Language Models (LLMs) and Llama-2 7B Deep Dive 50m
    • 2:30 PM 2:45 PM
      Break 15m
    • 2:45 PM 3:30 PM
      GroqWare Suite™ Developer Tools 45m
    • 3:30 PM 4:00 PM
      Best Practices and Q&A 30m