Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective
arXiv:2604.23267v1 Announce Type: new
Abstract: Large language models (LLMs) operate in two fundamental learning modes – fine-tuning (FT) and in-context learning (ICL) – raising key questions about which mode yields greater language proficiency and wh…