How long until local AI pays for itself? — Sunk Cost
- Assumptions you can change Electricity, $/kWh API speed, tok/s Assume API prices keep falling Where nothing has been measured, local speed is estimated as memory bandwidth ÷ bytes read per token × , and labelled as such.
- API speed only affects the time comparison.
Unverified
- Assumptions you can change Electricity, $/kWh API speed, tok/s Assume API prices keep falling Where nothing has been measured, local speed is estimated as memory bandwidth ÷ bytes read per token × , and labelled as such.
- API speed only affects the time comparison.
Sources: Sunkcost