The benchmarks may not show it but it's a substantial improvement over 3.5 for real world tasks. This model is performing better than GLM-5.1 and Kimi-k2.5 for me, and the biggest area of improvement has been reliability. It feels as reliable as c…
I am currently utilizing qwen3.5 and Gemma 4 model. Realized Gemma 4 requires 2x ram for same context length. As far as I understand, what turbo quant gives is quantizing kv cache into about 4 bit and minimize the loses But Q8 still not lose the cont…
sllm is an experiment in sharing GPUs between developers. I think everyone at some point in their agentic development journey thinks about hosting their own LLM. And if you can afford it, great, but I looked pretty deep into the economics and it's …
Is there a winner yet? submitted by /u/MLExpert000 [link] [comments]
Input: Say Hi to me submitted by /u/Hell_L0rd [link] [comments]
I'm looking to build a local setup for coding since using Claude Code has been kind of poor experience last 2 weeks. I'm pondering between 2 or 4 V100 (32GB) and 2 or 4 MI50 (32GB) GPUs to support this. I understand V100 should be snappier to r…
I’ve figured out how to trigger the reasoning process by adding "/think" to the system prompt. Heads up: the <|channel>thought tags have an unusual pipe (|) placement, which is why many LLM fail to parse the reasoning section corr…
LM Studio is an exceptional tool for running local LLMs, but it has a specific quirk: the "Thinking" (reasoning) toggle often only appears for models downloaded directly through the LM Studio interface. If you use external GGUFs from pr…
Qwen 3.5, Gemma-4, Nemotron Cascade 2 and GLM 4.7 flash. Tested to see how performance (speed) degrades with the context increase. used llama.cpp and some nice quants better fitting for 16GB VRAM in my RTX 4080. Here is a result comparison table….
submitted by /u/Inv1si [link] [comments]