Memorilla: Latent Semantic Memory for LLMs
- View PDF HTML (experimental) Abstract:Memory enables large language models (LLMs) to use information beyond their parameters, such as past user conversations, long documents, or an agent's earlier actions.
- For a frozen LLM, access to this accumulated knowledge is limited to what a memory system places in its context window.
- However, gathering and combining relevant information needed for each query while keeping the model's context short remains challenging for existing systems.
Unverified
- View PDF HTML (experimental) Abstract:Memory enables large language models (LLMs) to use information beyond their parameters, such as past user conversations, long documents, or an agent's earlier actions.
- For a frozen LLM, access to this accumulated knowledge is limited to what a memory system places in its context window.
- However, gathering and combining relevant information needed for each query while keeping the model's context short remains challenging for existing systems.
Sources: Arxiv