How an LLM Works, as a City
- idle Press Run to start The city is idle.
- Type a prompt below and watch a single token make the round trip.
- Residual stream idle 12 numbers standing in for the 4,096+ a real model carries.
Unverified
- idle Press Run to start The city is idle.
- Type a prompt below and watch a single token make the round trip.
- Residual stream idle 12 numbers standing in for the 4,096+ a real model carries.
Sources: Github