ZipCCL: Efficient Lossless Data Compression of Communication Collectives for Accelerating LLM Training
arXiv:2604.27844v1 Announce Type: cross
Abstract: Communication has emerged as a critical bottleneck in the distributed training of large language models (LLMs). While numerous approaches have been proposed to reduce communication overhead, the potent…