Your model might not be the problem: 13 KB rewrites took us from 60% to 100% extraction on Llama 3.1 8B
Most agent projects I see talk about the model first and the docs second. We ended up doing the opposite, and it’s the only reason our 8Bparameter agent actually works in production. We’re building a bounded domain data agent (Oracle Forge) that handle…