Author name: /u/Scared-Biscotti2287

Been fine-tuning llama 3.1 8b with Qlora for a classification task using about 8k samples. I was getting bad eval results for a while and kept thinking something was wrong with my data. Tried cleaning the dataset, tried different prompt templates, mess…

I've been renting 5090s on and off for qlora fine-tuning and inference, ended up trying hyperai, runpod, vast and gpuhub over the past couple months so figured id share what i ran into. Hyperai is around 35 cents an hour flat rate. no bidding, they…