I want to start using local AI properly. I am currently using Gemini, but I'd like to know if there are local AIs suitable for chatbots, novel writing, and music composition. Alternatively, are there any other local AIs you would recommend? My PC s…
I haven't seen benchmarks or tests for example with the "growing tree with branches and leaves prompt in html" so I am curious if there's really anything better than that for coding. submitted by /u/soyalemujica [link]…
https://preview.redd.it/u0nncyr9xwtg1.png?width=1459&format=png&auto=webp&s=1c7f55c4b0fc88c39f0424d8a3f965b5fa5bc328 Today, with great pride, I am excited to officially announce the first open-source AI model series emerging from Egyp…
I curate a weekly multimodal AI roundup, here are the local/open-source highlights from the last week: Google Gemma 4 – Open model family for coding and logical reasoning with a massive context window. Runs on a single machine. Post | Models TII…
As the title said, I'm looking and has anybody done a comparison with other 8B or similar parameter model yet? submitted by /u/AsrielPlay52 [link] [comments]
I like to be able to enable and disable thinking using a system prompt, so that I can control what which prompts generate thinking tokens rather than relying on the model to choose for me. It's one of the reasons I loved Qwen-30b-A3b. I'm havi…
I have been trying to use Gemma 4 for tool calling but kept getting errors like a lot of people. I asked ChatGPT to help me figure it out. Gave it the chat template, it had me try a few different messages, and the tool calls kept breaking. It could mak…
For the past 2 weeks, my daily routine has included checking the main llama.cpp releases to see if attn rotate has been merged. Am I missing something? I mean, it should be there already since the core rotation PR has been merged. Is it enabled b…
Hi. I'm trying to use llama.cpp to give me workable Gemma 4 inference, but I'm not finding anything that works. I'm using the latest llama.cpp, but I've tested it now on three versions. I thought it might just require me waiting until l…
If you're running dual Intel Arc GPUs with llama.cpp and your system RAM maxes out during multi-GPU inference, even though the model fits in VRAM, this post explains why and how to fix it. I've been running dual Arc Pro B70s (32GB each, 64GB to…