ALCF AI Testbed: Groq Training Workshop

Murali Emani (LCF) , Venkatram Vishwanath (LCF)

This virtual training workshop will introduce users to the GroqRack system deployed at the ALCF AI Testbed. This workshop targets researchers at universities, national labs, and industries working on open science. 

The training session will introduce users to the architecture and the software stack. It will provide hands-on training to get started on the GroqRack in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available. 

NOTE: The deadline for signing up for a new ALCF account to participate in the hands-on session has passed but you can register to attend the session. 

Day 1 will focus on GroqRack hardware and software architecture, GroqFlow and running models on this system at the ALCF AI Testbed.

Day 2 will focus on a deep dive into large language models, the MLAgility tool, a hands-on session, and best practices. 

If you have an active ALCF account, click Join Project to submit a membership request to join the project  "groq_training".

  • Wednesday, 6 December
    • 1:30 PM 1:35 PM
      Intro to ALCF AI Testbed 5m
    • 1:35 PM 1:40 PM
      Welcome to Groq 5m
    • 1:40 PM 2:10 PM
      Groq Language Processing Unit™ (LPU) Architecture 30m
    • 2:10 PM 2:25 PM
      Intro to MLAgility™ and GroqFlow™ 15m
    • 2:25 PM 3:25 PM
      Porting Models with GroqFlow™ 1h
    • 3:25 PM 3:40 PM
      Break 15m
    • 3:40 PM 4:25 PM
      Benchmarking Models with MLAgility™ 45m
    • 4:25 PM 5:10 PM
      Accessing GroqRack™ at ALCF AI Testbed 45m
  • Thursday, 7 December
    • 1:30 PM 1:50 PM
      Groq Compiler™ Overview 20m
    • 1:50 PM 2:10 PM
      Groq Runtime™ Overview 20m
    • 2:10 PM 3:10 PM
      Large Language Models (LLMs) and Llama-2 7B Deep Dive 1h
    • 3:10 PM 3:25 PM
      Break 15m
    • 3:25 PM 4:10 PM
      GroqWare Suite™ Developer Tools 45m
    • 4:10 PM 4:30 PM
      Enabling Research with Groq 20m