LocalLLaMA

It has been a while, and I can't access it. I wonder if it's just me. submitted by /u/gabrielxdesign [link] [comments]

Hey guys, we ran Qwen3.6-35B-A3B GGUF KLD performance benchmarks to help you choose the best quant. Unsloth quants have the best KLD vs disk space 21/22 times on the pareto frontier. GGUFs: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF We a…

Edit: I’m getting the consensus is that the budget I suggested is not enough for my lil ambitious project. I’d like to reshape the question for the upcoming comments: what’s the minimal budget to achieve my goal? And with which gpu configuration? Hell…

I've tried a few different local models in the past (gemma 4 being the latest), but none of them felt as good as this. (Or maybe I just didn't give them a proper chance, you guys let me know). But this genuinely feels like a model I could daily…

I've tried a few different local models in the past (gemma 4 being the latest), but none of them felt as good as this. (Or maybe I just didn't give them a proper chance, you guys let me know). But this genuinely feels like a model I could daily…

I spent some time yesterday after work trying out the new qwen3.6-35b-a3b model, and at least for me it's the first time that I actually felt that a local model wasn't more of a pain to use than it was worth. I've been using LLMs in my pers…

https://preview.redd.it/nxn2rr15vqvg1.png?width=1920&format=png&auto=webp&s=8ec85d90b1286a6e7813c91a0a83c748e94ca849 I gave it a task to build a tower defense game. use screenshots from the installed mcp to confirm your build. My God …

I am trying to retro-fit my home server for a bit of AI fun. Happened to acquire one 5060 ti 16gb at a very good price, and now trying to find a partner for it. The only problem is that my home server wasnt really bought based on PCI-E lanes. My board …

Hi all I'm a big user of Claude web UI for my projects I just built a dual Tesla v100 16gb local host and I'm doing some tinkering with it using open web UI and it's nice but it doesn't give the files in a easy downloadable way like Cla…

Hi guys, Back again. I have tested the Qwen 3.6 UD 2 K_XL Unsloth model on the same paper to web app task. The model is performing very well. It handled all tool calls properly and also managed large context using llama.cpp on a 16GB VRAM on lapt…