LocalLLaMA

New Local LLM Rig: Ryzen 9700X + Radeon R9700. Getting ~120 tok/s! What models fit best?

Hi ! I just finished building a workstation specifically for local inference and wanted to get your thoughts on my setup and model recommendations. •GPU: AMD Radeon AI PRO R9700 (32GB GDDR6 VRAM) •CPU: AMD Ryzen 7 9700X •RAM: 64GB DDR5 •OS: Fedora Work…