ALCF AI Testbed: Groq Training Workshop

Dec 6, 2023, 1:30 PM → Dec 7, 2023, 5:00 PM America/Chicago

Murali Emani (LCF), Venkatram Vishwanath (LCF)

This virtual training workshop will introduce users to the GroqRack system deployed at the ALCF AI Testbed. This workshop targets researchers at universities, national labs, and industries working on open science. 

The training session will introduce users to the architecture and the software stack. It will provide hands-on training to get started on the GroqRack in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available. 

NOTE: The deadline for signing up for a new ALCF account to participate in the hands-on session has passed but you can register to attend the session. 

Day 1 will focus on GroqRack hardware and software architecture, GroqFlow and running models on this system at the ALCF AI Testbed.

Day 2 will focus on a deep dive into large language models, the MLAgility tool, a hands-on session, and best practices. 

If you have an active ALCF account, click Join Project to submit a membership request to join the project  "groq_training".

ALCF x Groq Workshop Day 1.pdf

ALCF x Groq Workshop (Day 2).pdf

Groq_training_GettingStarted.pdf

Intro_AITestbed-Groqtraining-Dec23.pdf

Wednesday, December 6

1:30 PM → 1:35 PM Intro to ALCF AI Testbed

1:35 PM → 1:40 PM Welcome to Groq

1:40 PM → 2:10 PM Groq Language Processing Unit™ (LPU) Architecture

2:10 PM → 2:25 PM Intro to MLAgility™ and GroqFlow™

2:25 PM → 3:25 PM Porting Models with GroqFlow™

3:25 PM → 3:40 PM Break

3:40 PM → 4:25 PM Benchmarking Models with MLAgility™

4:25 PM → 5:10 PM Accessing GroqRack™ at ALCF AI Testbed

Thursday, December 7

1:30 PM → 1:50 PM Groq Compiler™ Overview

1:50 PM → 2:10 PM Groq Runtime™ Overview

2:10 PM → 3:10 PM Large Language Models (LLMs) and Llama-2 7B Deep Dive

3:10 PM → 3:25 PM Break

3:25 PM → 4:10 PM GroqWare Suite™ Developer Tools

4:10 PM → 4:30 PM Enabling Research with Groq