My experience with the Intel Arc Pro B70 for local LLMs: Fast, but a complete mess (for now)
full disclaimer using ai to help clean up my mess of thoughts. i have a tendency of not being coherent once i get many words out. TL;DR: Bought a B70 on launch day. Achieved an impressive 235 t/s with Gemma 3 27B on vLLM(100 requests), but the softwar…