tokens too cheap to meter
- The price of using machine learning intelligence is decreasing by several orders of magnitude a year and shows no signs of slowing.
- We are likely to see LLMs integrated into every part of computing as infrastructure, not just as a product, in the next year or two.
- We are likely to see LLMs running locally at current frontier-quality on commodity hardware in the next 3-6 years.
Unverified
- The price of using machine learning intelligence is decreasing by several orders of magnitude a year and shows no signs of slowing.
- We are likely to see LLMs integrated into every part of computing as infrastructure, not just as a product, in the next year or two.
- We are likely to see LLMs running locally at current frontier-quality on commodity hardware in the next 3-6 years.
Sources: Jyn