TRACE is a new open-source hierarchical memory system that organizes conversation history into a topic tree. It achieved 82.5% F1 on the MemoryAgentBench EventQA task using the gpt-oss-20B model. This work addresses a key limitation in LLM agents—flat memory retrieval—by introducing hierarchical topic trees, leading to significantly better performance than existing methods like Mem0 and MemGPT. The open-source release enables wider adoption and further research. The benchmark comparison is not apples-to-apples because TRACE used gpt-oss-20B while Mem0 and MemGPT used GPT-4o-mini; TRACE’s gpt-oss-120B version achieved 83.8% F1. The author noted issues with running Mem0 on gpt-oss due to JSON parsing constraints.
Background
LLM agents require memory systems to retain and retrieve information across long conversations. Traditional approaches use flat retrieval-augmented generation (RAG) that treats all history as equal chunks, which can lose contextual hierarchy. TRACE organizes memory into a topic tree with branches and summaries, allowing agents to navigate historical context more effectively. MemoryAgentBench is a benchmark from ICLR 2026 designed to evaluate memory capabilities in LLM agents.