LocalLLaMA

What llamacpp’s webui has and what it lacks

I've been on a quest testing chat UI's for development. So far out of Jan.ai, AnythingLLM, librechat, and Open Webui, llamacpp's webui is my favourite. The killer feature Counting my context used. I don't need to guess when my context i…