LocalLLaMA

Terrible Vulkan pp/tg on Arrow Lake iGPUs

Hi, I recently tried to get llama.cpp with SYCL running on an Arrow Lake system but gave up halfway through since Vulkan is just way easier to set up. But, the pp/tg I'm getting on Vulkan w/ Arc 130T is disgustingly bad – 100 tokens/s for pp256 and…