Hi folks, I built this GUI application and have open sourced it now for others. What does it solves? so its basically a UI wrapper on top of llama-server but as you know it has so many flags and usually people post here the optimal flags they fou…
Hey guys, I am a cyber security engineer and with my work I usually use claude with sub agents and skills to help me conduct my web and mobile application penetration testing. Help me with some exploit development and research I do. I want to try and d…
Hey everyone, I’m currently working on my master’s thesis on AI security for humanoid robots, with a focus on adversarial attacks for VLMs/VLAs. I’ve had some initial exposure to jailbreaking LLMs, but when it comes to VLMs and VLAs, I’m pretty new and…
It's a bit gloopy at the moment but have been messing around with training my own local world models that run on iPad. Last weekend I made this driving game that tries to interpret any photo into controllable gameplay. I also added the abilit…
FOR THE UNINITIATED: GHOST is an open source environment manager that breaks the NVIDIA monopoly. It allows you to run high performance AI models on AMD hardware by automatically injecting ZLUDA and ROCm layers into your Windows environment. No Linux, …
just quick numbers for anyone interested on new snapdragon chipset with windows on arm via llama.cpp ## Hardware – Snapdragon X2 Elite Extreme (X2E94100, Qualcomm Oryon Gen 3) – 18 cpu cores – 48 GB Unified Memory – ~228 GB/s peak memory bandwidth – Ad…
Let's test how good of a coding model Qwen3.6 really is using the OpenCode harness: https://www.youtube.com/live/3UJFADzV0OY submitted by /u/curiousily_ [link] [comments]
Our nonprofit association has an AI server with 2x RTX 3090 and I finally switched over to vLLM to get better performance for multiple users. Here's my docker compose file: services: vllm: image: vllm/vllm-openai:latest container_name: vllm deploy:…
Which LLM with under 10B params has the best ability to do web searches Is there any benchmark for this where i could see how certain models perform I've checked out gemma e4b it, is it any good for web searching compared to other alternatives at t…
I don't know if it's something I am doing horribly wrong or what, but running Open WebUI w/ Terminal on Docker with the models on LM Studio and I am starting to think the community keeps praising the tool calling feature just to cope lol Qwen3….