Author name: Mohammad R. Abu Ayyash

Three-Phase Transformer

Mohammad R. Abu Ayyash / April 17, 2026

arXiv:2604.14430v1 Announce Type: cross
Abstract: We present Three-Phase Transformer (3PT), a residual-stream structural prior for decoder-only Transformers on a standard SwiGLU + RMSNorm + RoPE + GQA backbone. The hidden vector is partitioned into N …

cs.AI, cs.CL

Brainstacks: Cross-Domain Cognitive Capabilities via Frozen MoE-LoRA Stacks for Continual LLM Learning

Mohammad R. Abu Ayyash / April 2, 2026

arXiv:2604.01152v1 Announce Type: new
Abstract: We present Brainstacks, a modular architecture for continual multi-domain fine-tuning of large language models that packages domain expertise as frozen adapter stacks composing additively on a shared fro…