Floks who praising Gemma4 above Qwen 3.5 are not serious users. Nobody care about one-shot chat prompts on this day of Agentic engineering. It is failing seriously and we cannot use it in any of proper coding agents : Cline , RooCode. Tried UD Qa…
https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF https://huggingface.co/unsloth/gemma-4-26B-A4B-it-GGUF by u/danielhanchen: We just updated them again in response to: kv-cache : support attention rotation for heterogeneous iSWA https://github.com/gg…
The last Llama (Scout/Maverick) was released a year ago. Since then US based releases have been super rare: Granite 3.3, GPT-OSS 20B & 120B, Nemotron 3 Nano / Super and now Gemma 4. Can't even compare to the solid Chinese open model outpu…
Results live here: https://www.idp-leaderboard.org/ Ran both through the IDP Leaderboard (OlmOCR Bench, OmniDocBench, IDP Core) and the headline numbers aren't the interesting part. Top-line scores: Benchmark Gemma 4 E4B Qwen3.5-4B OlmO…
it's the Gemma 4 26B A3B IQ4 NL. My llama.cpp command is: llama-server.exe -m "gemma-4-26B-A4B-it-UD-IQ4_NL.gguf" -ngl 999 -fa on -c 65536 -ctk q8_0 -ctv q8_0 –batch-size 1024 –ubatch-size 512 –temp 1.0 –top-k 64 –top-p 0.95 –min-p…
Processing video 4w0egf932ytg1… Hello lads. Wanted to share my test of GLM 5.1 from ZAI Deployed it on my company`s HGX H200 with this command docker run -d \ –name name \ –restart unless-stopped \ –gpus all \ –shm-size 32g \ –ipc=host \ -v … …
Qwen 3.5 35B on LocalAI: Vulkan vs ROCm Hey everyone! 👋 Just finished running a bunch of benchmarks on the new Qwen 3.5 35B models using LocalAI and figured I'd share the results. I was curious how Vulkan and ROCm backends stack up against ea…
The multimodal large model HappyHorse (an open-source unified large model for text-to-video/image-to-video + audio)has recently been making waves on the international stage. After verification from multiple sources, the team behind it has been re…
STEP3-VL-10B is a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence. Despite its compact 10B parameter footprint, STEP3-VL-10B excels in visual percep…
Trying pipeline VAD speech chunk > LLM > TTS skipping ASR part completely but audio just refuses to work tried multiple llama.cpp builds and unsloth studio no luck so far only thing that works is LiteRT LM by google but it forces cpu only infer…