I have this machine right now: MSI B550-A PRO Ryzen 5 5600X, 4x16GB DDR4 3200 MHz RTX 3090 – PCIe4 x16 (~25GB/s) RTX 3090 – PCIe3 x4 (<3GB/s..) I added the second GPU just recently and after a day of optimizing stuff settled on this setup: Model…
I was about to subscribe to the GLM Coding Plan on z.ai to try it with Claude Code. Pretty sure the tiers were Lite $10 / Pro $30 / Max $80 yesterday. Now I'm seeing $18 / $72 / $160. Did they just silently double the prices or am I experienc…
Feel like it’s been forever since they announced it; I wonder if it’s going to be better than Qwen 3.5 397b. submitted by /u/lolwutdo [link] [comments]
Most embedding models (BGE-M3, E5, ada-002, Cohere) weren't trained with Matryoshka losses, so you can't just drop trailing dimensions. We tried: truncating BGE-M3 from 1024 to 256 dims gives 0.467 cosine similarity. Unusable. The fix is embarr…
I am just imagining the face of the bride when she finds out ahhaah alot of protein!! I actually really hope that this is true I have literally been laughing for 5 minutes submitted by /u/Complete-Sea6655 [link] [comments]
I've been playing around with the new Gemma 4 31B and I'm impressed! Currently using it mainly for Python task automation and managing scripts from a web dashboard. It’s great to see how much local/SLMs (Small Language Models) are improving. Th…
Posted something when I initially got the GPU on r/IntelArc. Did not have vllm working at the time, so no real use case numbers. After many nights fighting with vllm, I finally got it to work. Here are some summery. both llama.cpp and llm-scaler-vllm …
According to Yuan he from Minimax the open weights should be releasing today or tomorrow! Personally, this is the model I’m most excited for because if it’s the same parameters as 2.5 running quantised versions can actually be viable (unlike the …
https://preview.redd.it/2h8fqazyuhug1.png?width=2276&format=png&auto=webp&s=12e4085c542b8b0c07ba908c736800a1922d95af You should redownload, as they include the updated chat template (see https://huggingface.co/google/gemma-4-26B-A4B-i…
Cursor's Composer is built on Kimi K2.5, which is Moonshot's Chinese model. Shopify switched to Alibaba's Qwen and saved $5 million a year. Airbnb CEO Brian Chesky has said publicly: "We rely a lot on Qwen. It's very good, fast, an…