Tried a few cloud gpu platforms for 5090 rental over the past couple months, heres what i noticed

I've been renting 5090s on and off for qlora fine-tuning and inference, ended up trying hyperai, runpod, vast and gpuhub over the past couple months so figured id share what i ran into.

Hyperai is around 35 cents an hour flat rate. no bidding, they also have free cpu instances. The platform is newer so the template side isn't as built out as some of the others.

Runpod is about a dollar an hour on secure cloud, less on community but availability on community is inconsistent. they got templates and decent docs. Community cloud is cheaper but the gpu you want isn't always there when you need it.

Vast pricing starts lower but it changes depending on the host and time of day. It's a marketplace model so you're picking between different providers. Some hosts are stable, some aren't.

Gpuhub is around 36-38 cents an hour with their membership. They have signup credits and referral bonuses. I only ran a couple jobs there so i dont have a ton to say about it yet.

The hardware is the same 5090 everywhere so performance wise there's no difference between any of them. I'm still learning and experimenting so for now I just stick with one that works for me mostly because at this stage I'm running tons of small jobs and lower cost makes more sense while I'm still figuring things out.

submitted by /u/Scared-Biscotti2287
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top