ALCF AI Testbed: Cerebras AI Training Workshop

May 7, 2024, 1:00 PM → May 8, 2024, 4:30 PM America/Chicago

Murali Emani (LCF) , Venkatram Vishwanath (LCF)

This training workshop will introduce users to the novel AI accelerators deployed at the ALCF AI Testbed. This workshop is targeted at universities, national labs, and industries working on open science.

This training session will introduce users to the Cerebras CS-2 system architecture and software stack. It will provide hands-on training to get started on the CS-2 system in the ALCF AI testbed. The event will be virtual and the sessions will be recorded and made available.

NOTE: Please register and sign-up/reactivate your ALCF Account by 04/05 if you would like to participate in the hands-on session. 

Day 1 will focus on Cerebras CS-2 hardware and software architecture, running models on the CS-2 system at ALCF AI Testbed.

Day 2 will focus on a deep dive into Large Language Models (LLMs) on CS-2, hands-on session, open source projects, and best practices.

To Access ALCF machines please see the instructions below. Deadline to complete the following is 04/05:

• New Users: Request an ALCF Computer User Account if you do not currently have one. Specify "aitestbed_training" as the project name.
• Previous Users: If you have an ALCF Account that is currently inactive, submit an account reactivation request. Specify "aitestbed_training" as the project name.
• Current Users: If you have an active ALCF account, click Join Project to submit a membership request for the project "aitestbed_training".

Tuesday, 7 May

1:00 PM → 1:10 PM Cerebras CS-2 Introduction

1:10 PM → 1:45 PM Hardware and Systems

1:45 PM → 2:20 PM Software and Programming

2:20 PM → 2:30 PM Break

2:30 PM → 3:00 PM Value and use cases for science

3:00 PM → 3:30 PM Getting started: model definition

3:30 PM → 4:15 PM Demo: How to use CS-2 @ ALCF

Wednesday, 8 May

1:00 PM → 1:40 PM Demo: training large language models (LLMs) on CS-2

1:40 PM → 2:00 PM Demo: Large context windows on CS-2

2:00 PM → 2:30 PM Review and demo: sparsity-accelerated training on CS-2

2:30 PM → 2:40 PM Break

2:40 PM → 3:10 PM Vision Transformer Models on CS-2

3:10 PM → 3:30 PM Open-source developments for open science

3:30 PM → 4:15 PM Best Practices, Q&A