After seeing Karpathy's tweet about using LLMs to build personal wikis from research documents, I realized I'd already been using something similar like this internally for our R&D. So I cleaned it up and open-sourced it. What it does: You …
Been experimenting with it, first on my buddy's compute he let me borrow, and then with the Gemini SDK so that I don't need to keep stealing his macbook from 600 miles away. Originally my home agent was run through Gemini-3-Flash because no oth…
Hey everybody, I have a strong interest in offloading work to small, specialized models that I can parallelize – this lets me scale work significantly (plus, I am less dependent on proprietary APIs) Some time ago, I saw a blog post from Wiz about…
I posted about my APEX quantization of QWEN Coder 80B Next yesterday and got a ton of great questions. Some people loved it, some people were skeptical, and one person asked "what exactly is the point of this when K quants already do mixed precisi…
What I used Samsung S21 Ultra Termux llama-cpp-cli llama-cpp-server Qwen3.5-0.8B with Q5_K_M quantization from huggingface (I also tried Bonsai-8B-GGUF-1bit from huggingface. Although this is a newer model and required a different setup, which I…
Hi all, I’ve been thinking a lot about the impact of AI on the software development industry. While I use AI tools to speed up my workflow, it’s clear that the landscape is shifting fast, and pure coding might not be enough to secure a job in the futur…
PokeClaw – A Pocket Version of OpenClaw Most "private" AI assistants are private because the company says so. PokeClaw is private because there's literally no server component. The AI model runs on your phone's CPU. There's…
I have found python turtle to be a pretty good test for a model. All of these models have received the same prompt: "write a python turtle program that draws a cat" you can actually see similarity in gemma's and gemini pro's out…
we can use continuous batching for an agent swarm to actually kill research time. found performance for qwen 27b on that intel b70 32gb card. if you just chat one on one, you get: avg prompt throughput: 85.4 tokens/s avg generation throughput: 13…
I have run two tests on each LLM with OpenCode to check their basic readiness and convenience: – Create IndexNow CLI in Golang (Easy Task) and – Create Migration Map for a website following SiteStructure Strategy. (Complex Task) Tested Qwen 3.5, …