LocalLLaMA

Great analysis of how the different KV rotation methods perform. Tl;dr: saw is what you want.

/

submitted by /u/fredandlunchbox [link] [comments]