Author name: /u/1ncehost

Video of how my LLM’s decoder blocks changed while training

/u/1ncehost / April 15, 2026

This is in response to my popular post: https://www.reddit.com/r/LocalLLaMA/comments/1sivm24/heres_how_my_llms_decoder_block_changed_while/ It was requested that I make a video of this data, so here it is. Enjoy! submitted by /u/1nc…

LocalLLaMA

Here’s how my LLM’s decoder block changed while training on 5B tokens

/u/1ncehost / April 11, 2026

I'm monitoring an experimental model's ongoing training. I replaced the MLP decoders of a traditional transformer with discrete lower-dimensional spline manifold geometry described in my K-Splanifolds paper. The image shows how layer 96 o…