LocalLLaMA

submitted by /u/iamapizza [link] [comments]

We benchmarked Qwen 3.5-27B against 10 other models on backend generation — including Claude Opus 4.6 and GPT-5.4. The outputs were nearly identical. 25x cheaper. TL;DR Qwen 3.5-27B achieved 100% compilation on all 4 backend projects Todo, Redd…

submitted by /u/Repulsive-Mall-2665 [link] [comments]

https://preview.redd.it/6v2q5726j0ug1.png?width=2950&format=png&auto=webp&s=142b34c6829d80d7ff807a3a589441463d0babf9 I've had aerosinusitis a few times before in my life and it was fairly painful, but not something that happens of…

I’ve been testing different tools trying to find the best AI note taking app for meetings, and they all seem to hit the same limit. The transcripts are usually fine. Summaries look clean. But once conversations get messy, they still miss nuance or prio…

Over the last week, I’ve been investigating cache misses while optimizing local agent workflows on my M5 Max. My setup used oMLX.ai as a backend with agents like OpenCode.ai and Pi.dev, but I reproduced the same behavior with other backends like llama….

Not a chatbot pretending. Not a lookup table with a trench coat. A proper decoder-only transformer. Attention, RMSNorm, feed-forward, residuals, the works. Two layers, four heads, about 25,000 parameters. All int8. Trained with quantization-aware…

https://preview.redd.it/wqk6fh12d0ug1.jpg?width=4096&format=pjpg&auto=webp&s=292562e4000da9239b21ca5dc0e01adcf127f127 Hello everyone! Based on the community's feedback in previous post, I decided to write this post to clarify and …

Source: https://x.com/AIatMeta/status/2041910285653737975?s=20 submitted by /u/jd_3d [link] [comments]

LFM2.5‑VL-450M is Liquid AI's refreshed version of the first vision-language model, LFM2-VL-450M, built on an updated backbone LFM2.5-350M and tuned for stronger real-world performance. Small but good submitted by /u/edward-dev…