https://preview.redd.it/bixb4erga2wg1.png?width=1464&format=png&auto=webp&s=2df10ab305a5cf4c4252496ec3df34422359066b This is on RTX 3090 , llama.ccp main , linux arch. So what is everybody's experience so far , ive tested a few qu…
qwen 3.6 has been working great and has got me wondering. submitted by /u/GotHereLateNameTaken [link] [comments]
First-time local LLM user here! I’m running an old HP Z640 workstation with a dual Xeon E5-V4 setup (around 100GB of RAM). It used to have a Titan X Pascal GPU, but I swapped it out for an Arc B70. I’m not sure if the motherboard supports PCI rebar, bu…
So the Qwen vocab has distinct tokens for <think> and </think>. I know this because an app I wrote pushes those tokens to the cache after <|im_start|>assistant to stop CoT selectively. Great. Yesterday I was fucking around with some c…
Sum B+a+c+k+g+r+o+u+n+d: I've been working on an open source agentic tabletop GM as a leisure project intended to run on any LLM with tool support. I started it as a Claude Code skill to run D&D sessions and eventually generalized it to b…
Thanks submitted by /u/br_web [link] [comments]
Hey everyone, I have a system with 32GB of system RAM and two GPUs: RTX 3090 (24GB) in the primary fast PCIe slot RTX 3060 (12GB) in a secondary, slower PCIe slot I'm assuming that splitting a single large model across both cards is a bad idea b…
I was super curious about the Reachy Mini, got one and during this weekend me and my 12 years kid put the pieces together, just followed the manual that came with the robot. Very easy to read, clear diagrams and instructions, we just did it really quic…
of course this is just a trust me bro post but I've been testing various local models (a couple gemma4s, qwen3 coder next, nemotron) and I noticed the new qwen3.6 show up on LM Studio so I hooked it up. VERY impressed. It's super fast to respon…
Wrote a long-form technical post on what’s actually happening under the LangGraph API. The main insight that surprised me: LangGraph’s StateGraph is a high-level abstraction over a Pregel runtime. The real primitives are actors (PregelNodes) and channe…