How Cerebras Deploys Trillion-Parameter AI Models
- One of the most frequently asked questions we get is how we deploy large models on Cerebras wafer-scale chips.
- A single Cerebras WSE-3T wafer has 44 GB of on-chip memory, and trillion-parameter frontier models need terabytes for their weights alone.
- In this post, we’ll explain how we split a large frontier model across multiple WSE-3T wafers, to run multi-trillion parameter models at 1000-2000+ tokens per second.
Unverified
- One of the most frequently asked questions we get is how we deploy large models on Cerebras wafer-scale chips.
- A single Cerebras WSE-3T wafer has 44 GB of on-chip memory, and trillion-parameter frontier models need terabytes for their weights alone.
- In this post, we’ll explain how we split a large frontier model across multiple WSE-3T wafers, to run multi-trillion parameter models at 1000-2000+ tokens per second.
Sources: Cerebras