Accidentally discovered you can teach frozen MoE models new knowledge by just steering their expert routing — no training needed

Was probing Gemma 4's MoE routing patterns out of curiosity and noticed something weird experts route differently when the model "knows" something vs. when it doesn't.

So I recorded that difference and replayed it. Called it Adaptive Cognitive Intelligence (ACI).

Result: A 154KB file makes Gemma 4 go from "Starfield is NOT available on PS5" (181 words, confidently wrong) → "Starfield released on PS5 in April 2026 with DualSense haptics" (31 words, correct).

No weight modification. No LoRA. No RAG. Just routing.

pip install mnemic-mre

GitHub: https://github.com/vignesan/mnemic-mre

Early alpha — solo dev, tested mainly on Gemma 4 26B so far. Feedback welcome.

submitted by /u/superman_27
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top