Run Larger LLMs on Runpod Serverless Than Ever Before – Llama-3 70B (and beyond!) | Runpod Blog

Runpod Serverless now supports multi-GPU workers, enabling full-precision deployment of large models like Llama-3 70B. With optimized VLLM support, flashboot, and network volumes, it's never been easier to run massive LLMs at scale.