LocalLLaMA

[ Removed by Reddit on account of violating the content policy. ] submitted by /u/ecompanda [link] [comments]

Body: Context for this sub: engram is a persistent codebase memory for AI coding tools. Everything runs locally. Zero cloud, zero telemetry, zero LLM calls to build the graph, zero native dependencies. The graph is a plain SQLite file at .engram/graph….

Hey Everyone In a previous post I had mentioned I found out Gemma 4 has MTP. Turns out I was able to extract the model weights, but now I need help from the community, especially people who know C++ to help reverse engineer the MTP from the compi…

TL;DR: META's New AI Can Predict Your Brain Better Than A Brain Scan. Abstract: Cognitive neuroscience is fragmented into specialized models, each tailored to specific experimental paradigms, hence preventing a unified model of cognition in…

This might be super old news to some people, but I only just recently started using local models due to them only just now meeting my standards for quality. I just want to share the setup I have for web searching/scraping locally. I use Qwen3.5:27B-Q3_…

submitted by /u/Wonderful-Ad-5952 [link] [comments]

Gemma-4-E2B + Whisper STT + Kokoro TTS + Live2D submitted by /u/Tasty-Lobster-8915 [link] [comments]

Looks like these were released six days ago. Did a search and didn't see a post about them. https://huggingface.co/AIDC-AI/Marco-Mini-Instruct https://huggingface.co/AIDC-AI/Marco-Nano-Instruct Pretty wild parameter/active ratio, should be lightni…

Wasted 4 hours hand drawing this during work for some reason. submitted by /u/Box_Robot0 [link] [comments]

Hi everyone, ​I'm trying to set up a project using Gemma-4-E4B-it where I can point a live camera at different physical items, have the model identify them, and then output the names of those items translated into different languages (specifically …