ALCF AI Testbed: Cerebras AI Training Workshop
from
Tuesday, May 7, 2024 (1:00 PM)
to
Wednesday, May 8, 2024 (4:40 PM)
Monday, May 6, 2024
Tuesday, May 7, 2024
1:00 PM
Cerebras CS-2 Introduction
Cerebras CS-2 Introduction
1:00 PM - 1:20 PM
1:20 PM
Hardware and Systems
Hardware and Systems
1:20 PM - 1:35 PM
1:35 PM
Software and Programming
Software and Programming
1:35 PM - 1:50 PM
1:50 PM
Break
Break
1:50 PM - 2:00 PM
2:00 PM
How-to: Model porting, layer API, data loaders
How-to: Model porting, layer API, data loaders
2:00 PM - 2:30 PM
2:30 PM
Huggingface to CS-2 overview
Huggingface to CS-2 overview
2:30 PM - 2:45 PM
2:45 PM
How-to: Monitoring and profiling
How-to: Monitoring and profiling
2:45 PM - 3:05 PM
3:05 PM
Break
Break
3:05 PM - 3:15 PM
3:15 PM
Hands-on session for training at ALCF
Hands-on session for training at ALCF
3:15 PM - 4:00 PM
4:00 PM
Release 2.2.1 highlights
Release 2.2.1 highlights
4:00 PM - 4:30 PM
Wednesday, May 8, 2024
1:00 PM
Efficient training with Cerebras, scaling laws, how to train LLMs
Efficient training with Cerebras, scaling laws, how to train LLMs
1:00 PM - 1:45 PM
1:45 PM
User training: hands-on LLM model
User training: hands-on LLM model
1:45 PM - 2:45 PM
2:45 PM
Break
Break
2:45 PM - 3:00 PM
3:00 PM
HPC: CS for HPC: SDK, CSL and past examples
HPC: CS for HPC: SDK, CSL and past examples
3:00 PM - 4:00 PM
4:00 PM
Roadmap presentation
Roadmap presentation
4:00 PM - 4:20 PM
4:20 PM
Closing, final Q&A
Closing, final Q&A
4:20 PM - 4:30 PM