Mesh LLM: distributed AI computing on iroh
- When people picture running a large language model, they picture a data center.
- Racks of GPUs that belong to someone else, a metered API, and a bill that grows every month you succeed.
- You send your prompts off to a black box and hope the price, the model, and the privacy policy all stay the way they were when you signed up.
Unverified
- When people picture running a large language model, they picture a data center.
- Racks of GPUs that belong to someone else, a metered API, and a bill that grows every month you succeed.
- You send your prompts off to a black box and hope the price, the model, and the privacy policy all stay the way they were when you signed up.
Sources: Iroh