I made a UI and server for using Anthropic’s new Natural Language Autoencoders locally with llama.cpp
Anthropic's first open weight models, Natural Language Autoencoders, are just finetunes of popular open weight models. They do not modify architecture and modeling code so inference with llama.cpp is mostly trivial. I packaged every feature …