In-context Learning vs. Instruction Tuning: The Case of Small and Multilingual Language Models
arXiv:2503.01611v3 Announce Type: replace
Abstract: Instruction following is a critical ability for Large Language Models to perform downstream tasks. The standard approach to instruction tuning has relied on a specific phase of supervised fine-tuning…