Soft Head Selection for Injecting ICL-Derived Task Embeddings
arXiv:2507.20906v3 Announce Type: replace
Abstract: Large language models (LLMs) are commonly adapted to downstream tasks using parameter-efficient fine-tuning (PEFT) or in-context learning (ICL). Recently, ICL-driven embedding-based adaptation has be…