ALCF AI Testbed: Groq AI Training Workshop

America/Chicago
Murali Emani (LCF), Venkatram Vishwanath (LCF)
Description

This virtual training workshop will introduce users to the GroqRack system deployed at the ALCF AI Testbed. This workshop targets researchers at universities, national labs, and industries working on open science. 

The training session will introduce users to the architecture and the software stack. It will provide hands-on training to get started on the GroqRack in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available. 

NOTE: Please register and sign-up/reactivate your ALCF Account by 05/01 if you would like to participate in the hands-on session. 

Day 1 will focus on GroqRack hardware and software architecture, GroqFlow and running models on this system at the ALCF AI Testbed.

Day 2 will focus on a deep dive into large language models, the MLAgility tool, a hands-on session, and best practices. 

To Access ALCF machines please see the instructions below. Deadline to complete the following is 5/01:

  • New Users: Request an ALCF Computer User Account if you do not currently have one. Specify "aitestbed_training" as the project name.
  • Previous Users: If you have an ALCF Account that is currently inactive, submit an account reactivation request. Specify "aitestbed_training" as the project name.
  • Current Users: If you have an active ALCF account, click Join Project to submit a membership request for the project "aitestbed_training".
Registration
Participants
    • 1
      Intro to ALCF AI Testbed
    • 2
      Welcome to Groq
    • 3
      Groq Language Processing Unit (LPU)™ Architecture
    • 4
      Accessing GroqRack™ at ALCF AI Testbed
    • 2:25 PM
      Break
    • 5
      Porting Models with GroqFlow™
    • 6
      Benchmarking Models with MLAgility™
  • Wednesday, June 5
    • 7
      Groq Compiler™ Overview
    • 8
      Groq Runtime™ Overview
    • 9
      LLMs with Groq
    • 2:00 PM
      Break
    • 10
      Throughput Optimization
    • 11
      Whats Next