APPA: Adaptive Preference Pluralistic Alignment for Fair Federated RLHF of LLMs
arXiv:2604.04261v1 Announce Type: cross
Abstract: Aligning large language models (LLMs) with diverse human preferences requires pluralistic alignment, where a single model must respect the values of multiple distinct groups simultaneously. In federate…