[ Removed by Reddit ]
[ Removed by Reddit on account of violating the content policy. ] submitted by /u/ecompanda [link] [comments]
LocalLLaMA
LocalLLaMA
local models lose tool call context around call 8 or 9. here is what helped
been running qwen 32b, gemma 9b, and command r 32b on my M4 mac mini for a few weeks for agent tasks, and there is a specific failure mode nobody talks about enough. all three start losing context around tool call 8 or 9 in a chain. the symptom: first …