Is there “Secret Sauce” in Large Language Model Development?
arXiv:2602.07238v2 Announce Type: replace
Abstract: Do leading LLM developers possess a proprietary “secret sauce”, or is LLM performance driven by scaling up compute? Using training and benchmark data for 809 models released between 2022 and 2025, …