ALCF AI Testbed: Cerebras AI Training Workshop
from
Monday, July 17, 2023 (1:30 PM)
to
Tuesday, July 18, 2023 (5:00 PM)
Monday, July 17, 2023
1:30 PM
Cerebras CS-2 Introduction
Cerebras CS-2 Introduction
1:30 PM - 1:40 PM
1:40 PM
Hardware and Systems
Hardware and Systems
1:40 PM - 2:10 PM
2:10 PM
Software and Programming
Software and Programming
2:10 PM - 2:40 PM
2:40 PM
Break
Break
2:40 PM - 2:45 PM
2:45 PM
Value and use cases for science
Value and use cases for science
2:45 PM - 3:15 PM
3:15 PM
Getting started: model definition
Getting started: model definition
3:15 PM - 3:45 PM
3:45 PM
Demo: How to use CS-2 @ ALCF
Demo: How to use CS-2 @ ALCF
3:45 PM - 4:30 PM
Tuesday, July 18, 2023
1:30 PM
Demo: training large language models (LLMs) on CS-2
Demo: training large language models (LLMs) on CS-2
1:30 PM - 2:15 PM
2:15 PM
Review and demo: sparsity-accelerated training on CS-2
Review and demo: sparsity-accelerated training on CS-2
2:15 PM - 2:45 PM
2:45 PM
Break
Break
2:45 PM - 2:50 PM
2:50 PM
Demo: Large context windows on CS-2
Demo: Large context windows on CS-2
2:50 PM - 3:10 PM
3:10 PM
Open-source developments for open science
Open-source developments for open science
3:10 PM - 3:25 PM
3:25 PM
Demo: UNet for computer vision applications
Demo: UNet for computer vision applications
3:25 PM - 3:45 PM
3:45 PM
Best Practices, Q&A
Best Practices, Q&A
3:45 PM - 4:15 PM