Author name: /u/No_Algae1753

Hi everyone, I've been following the discussions around OpenCode for a while now and recently came across an older thread discussing significant privacy concerns https://www.reddit.com/r/LocalLLaMA/comments/1rv690j/opencode_concerns_not_truely_loca…

Has anyone here tested speculative decoding in llama.cpp with Gemma 4 31B IT or Qwen 3.5 27B? For Gemma, I was thinking about using a smaller same-family draft model. For Qwen 3.5, I’m not sure if it works well at all in llama.cpp. If you tried it, whi…