Author name: /u/Franck_Dernoncourt

Orthrus-Qwen3-8B : up to 7.8×tokens/forward on Qwen3-8B, frozen backbone, provably identical output distribution

/u/Franck_Dernoncourt / May 15, 2026

Code: https://github.com/chiennv2000/orthrus Paper: https://arxiv.org/abs/2605.12825 HF: https://huggingface.co/chiennv/Orthrus-Qwen3-1.7B ; https://huggingface.co/chiennv/Orthrus-Qwen3-4B ; https://huggingface.co/chiennv/Orthrus-Qwen3-8B Disclo…

MachineLearning

Orthrus: Memory-Efficient Parallel Token Generation via Dual-View Diffusion [R]

/u/Franck_Dernoncourt / May 15, 2026

Paper: https://arxiv.org/abs/2605.12825 Code: https://github.com/chiennv2000/orthrus Disclosure: co-author. Idea: Inject a trainable diffusion attention module into each layer of a frozen AR Transformer. Both heads share one KV cache. Diffusion…