Going local with old GPUs

Going local with old GPUs

I'm an ex crypto miner with remnant mining parts so I threw them together into a franken hydra case. I've been using claude oath previously, but they just shut that door last week or so.

I need to catch up on local inference know how. Any sites that can help with this? So far I have this rig of mixed 5090, 3090s, 3090ti on a x299 Sage Asus board. So far i've tested Ollama, vLLM and Aphrodite Engine.

Any sites like hashrate.no that post undervolt overclock settings to maximize the hardware and save power?

https://preview.redd.it/dl0qj66oeyug1.jpg?width=2048&format=pjpg&auto=webp&s=9942c1b81b95d0e044f7b0c3aaad89a72975cc59

https://preview.redd.it/jyltho6oeyug1.jpg?width=1536&format=pjpg&auto=webp&s=6840b5a0419ce10e2a52f42dbd70017954b4ba9c

https://preview.redd.it/gkk3o96oeyug1.jpg?width=2048&format=pjpg&auto=webp&s=69bc1da64d8fcb2ffbf5ff7243a4d39d4a7196f7

https://preview.redd.it/j1jki66oeyug1.jpg?width=2048&format=pjpg&auto=webp&s=943bffeda8b15cd28066fd19e4dd719bd9cab43f

submitted by /u/AbbreviationsSad5582
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top