Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data
- That success is built on static pretraining data.
- A deployed model faces a different world, where much of the data that would make it more useful is not in its training set but in the live interaction it is currently handling, such as the facts a user supplies or the corrections they
Unverified
- That success is built on static pretraining data.
- A deployed model faces a different world, where much of the data that would make it more useful is not in its training set but in the live interaction it is currently handling, such as the facts a user supplies or the corrections they
Sources: Arxiv