Persistent memory system for LLMs that actually learns mid-conversation

Persistent memory system for LLMs that actually learns mid-conversation

Every LLM conversation starts from zero. RAG helps, but it can't learn from what's happening right now. MDA is my attempt to fix that.

MDA encodes knowledge as associative entity networks, updates in real-time via the Oja rule (no backprop, no reindexing), and retrieves context by activating concept graphs rather than similarity search. Runs CPU-first, model-agnostic, works with Ollama/OpenAI/Anthropic out of the box. Available as an MCP server, with GPU acceleration support for batch workloads.

One thing I find genuinely interesting: multiple agents can share the same MDA instance and reason over a common memory. Agent A learns something, Agent B picks it up through associative traversal, not by searching for it, but because the concept network connects them. It starts to feel less like retrieval and more like shared intuition.

https://preview.redd.it/tfo3viz76xyg1.png?width=900&format=png&auto=webp&s=f09d4a3f8a2c0e39316f5a655904d04f6815a401

On the benchmark: these numbers come from synthetic questions I wrote myself, not a community-constructed eval. Take them as directional, not definitive. MDA is not a RAG killer the goal is to cover what RAG and LLMs leave on the table, not replace them. If you run your own tests and find different results, I'd genuinely want to hear it.

RAG (ChromaDB + bge-large-en-v1.5) MDA
Overall accuracy 67.5% 82.5%
Context per query baseline 3.1× less
Retention at 200 turns 0% 92%
A-early (turns 1-10) 70% 80%
B-mid (turns 25-44) 90% 100%
C-late (turns 100-119) 90% 100%
Cross-cluster 20% 50%

Inference model: Qwen3 6-35B-A3B / Judge model: Claude Haiku

If you'd like to share what you think MDA does well or where it falls short, I'd love to hear it.

Source code: https://github.com/rangle2/mda

submitted by /u/One-Pain6799
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top