 | I was looking for a "spot-on" fine-tuning guide since quite a while, but couldn't find one. So i thought: Let's write it myself. It covers Full-SFT as well as LoRA and QLoRA. This one is for NVIDIA and Single-GPU, but if you guys like i will later add Multi-GPU Training, AMD and Pre-training, too. I describe the process from installing the correct drivers and libs, preparing the dataset up to training and the final GGUF creation. Enjoy and let me know what you think or what i could improve further. Full Text: [link] [comments] |
