ALCF AI Testbed: Cerebras AI Training Workshop

Jul 17, 2023, 1:30 PM → Jul 18, 2023, 5:00 PM America/Chicago

Murali Emani (LCF) , Venkatram Vishwanath (LCF)

This training workshop will introduce users to the novel AI accelerators deployed at the ALCF AI Testbed. This workshop is targeted at universities, national labs, and industries working on open science.

This training session will introduce users to the Cerebras CS-2 system architecture and software stack. It will provide hands-on training to get started on the CS-2 system in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available.

NOTE: Please register by 07/10 if you would like to participate in the hands-on session. 

Day 1 will focus on Cerebras CS-2 hardware and software architecture, running models on the CS-2 system at ALCF AI Testbed.

Day 2 will focus on a deep dive into Large Language Models (LLMs) on CS-2, hands-on session, and best practices.

To Access ALCF machines please apply here:

• New Users: Request an ALCF Computer User Account if you do not currently have one
• Previous Users: If you have an ALCF Account that is currently inactive, submit an account reactivation request.
• Current Users: If you have an active ALCF account, click Join Project to submit a membership request.

Specify the following in your request:

• Project Name:  cs2_training
• Principal Investigator (PI):  Venkatram Vishwanath

 

ANL-CS-workshop-July23.pdf

Intro_AITestbed-CStraining-July23.pdf

Monday, 17 July

1:30 PM → 1:40 PM Cerebras CS-2 Introduction

1:40 PM → 2:10 PM Hardware and Systems

2:10 PM → 2:40 PM Software and Programming

2:40 PM → 2:45 PM Break

2:45 PM → 3:15 PM Value and use cases for science

3:15 PM → 3:45 PM Getting started: model definition

3:45 PM → 4:30 PM Demo: How to use CS-2 @ ALCF

Cerebras_CS2_training_GettingStarted.pdf

Tuesday, 18 July

1:30 PM → 2:15 PM Demo: training large language models (LLMs) on CS-2

2:15 PM → 2:45 PM Review and demo: sparsity-accelerated training on CS-2

2:45 PM → 2:50 PM Break

2:50 PM → 3:10 PM Demo: Large context windows on CS-2

3:10 PM → 3:25 PM Open-source developments for open science

3:25 PM → 3:45 PM Demo: UNet for computer vision applications

3:45 PM → 4:15 PM Best Practices, Q&A