Author name: /u/Iory1998

Tutorial – How to Toggle On/OFf the Thinking Mode Directly in LM Studio for Any Thinking Model

/u/Iory1998 / April 4, 2026

LM Studio is an exceptional tool for running local LLMs, but it has a specific quirk: the "Thinking" (reasoning) toggle often only appears for models downloaded directly through the LM Studio interface. If you use external GGUFs from pr…

LocalLLaMA

My biggest Issue with the Gemma-4 Models is the Massive KV Cache!!

/u/Iory1998 / April 3, 2026

I mean, I have 40GB of Vram and I still cannot fit the entire Unsloth Gemma-4-31B-it-UD-Q8 (35GB) even at 2K context size unless I quantize KV to Q4 with 2K context size? WTF? For comparison, I can fit the entire UD-Q8 Qwen3.5-27B at full context witho…