What do people think about this card for an enthusiast? With 48GB. You can fit qwen 27B q8 with context. It's still pricy, I get that. But the 48 GB seems nice. The next step up would be almost double the price. $4500 vs $9000.
I would use this for finetune and inference.
I like the idea of keeping all the ram in one card vs splitting with 2x 5090s
Also - Are people really getting RTX6000s for ~$7K?
[link] [comments]