Mac LLM Calculator: RAM and Tokens per Second for Local Models
- CalculatorWhich Mac runs which LLM, and how fastTwo numbers decide everything about running a model locally on Apple Silicon.
- Whether it fits in unified memory, which is arithmetic on the parameter count.
- And how fast it generates, which is memory bandwidth divided by the size of the weights.
Unverified
- CalculatorWhich Mac runs which LLM, and how fastTwo numbers decide everything about running a model locally on Apple Silicon.
- Whether it fits in unified memory, which is arithmetic on the parameter count.
- And how fast it generates, which is memory bandwidth divided by the size of the weights.
Sources: Macyou