When does it make sense to rent GPUs vs buying?

I only need GPU power sometimes, not all the time. Buying hardware feels too expensive, but cloud also gets pricey if I use it wrong. How do you decide what’s better? Do you just rent when needed or still prefer owning a setup?