Llama4 108b $800 setup
If you’ve ever wanted to run big models on cheap hardware look no further. I bought a retired home lab pc yesterday (dell precision 7820) dual intel xeons 128gbs ddr4. Threw in my 3060ti and believe it or not it runs. Almost entirely on cpu power…