KALAVAI: Predicting When Independent Specialist Fusion Works — A Quantitative Model for Post-Hoc Cooperative LLM Training
arXiv:2603.22755v2 Announce Type: replace
Abstract: Independently trained domain specialists can be fused post-hoc into a single model that outperforms any individual specialist, and the gain is predictable: gain = 0.82 x divergence – 2.72 (R^2 = 0.85…