Stanford has open-sourced Memorilla, a potential memory module for freezing LLM development
Stanford researchers have open-sourced Memorilla, a potential memory system designed for frozen LLMs. It converts the entire document collection into 16 vectors for use by frozen LLMs. On FactKG, the frozen Qwen3-8B paired with Memorilla achieves an accuracy of 84.33%, which is 3.9% higher than using all document contexts, but only requires 16 memory tokens, reducing the number of document tokens by 108 times.














