What starts to become possible with two 3090s that wasn’t with just one?
qwen 3.6 has been working great and has got me wondering. submitted by /u/GotHereLateNameTaken [link] [comments]
LocalLLaMA
LocalLLaMA
Qwen 3.6 q8 at 50t/s or q4 at 112 t/s?
What are some ways that you would go about thinking about choosing between the two for use in a harness like pi? Did a good bit with q4 yesterday and it was so consistent and reliable I had it set to 131k context and it worked through 2 compactings on …