Constraint-based Pre-training: From Structured Constraints to Scalable Model Initialization
arXiv:2604.14769v1 Announce Type: new
Abstract: The pre-training and fine-tuning paradigm has become the dominant approach for model adaptation. However, conventional pre-training typically yields models at a fixed scale, whereas practical deployment …