Ultra-Low-Dimensional Prompt Tuning via Random Projection
arXiv:2502.04501v3 Announce Type: replace
Abstract: Large language models achieve state-of-the-art performance but are increasingly costly to fine-tune. Prompt tuning is a parameter-efficient fine-tuning method that addresses parameter-efficiency by l…