Having a hard time fine tuning with LoRA
#21
by
						
abcampbell
	
							
						- opened
							
					
Spent 4 hrs and lots of conflicts btw transformers, sft and other pakcages the tuner needs, has anyone got a fine tuned version running?
I spent 5 hours trying to figure out today but I found this source and I think it works (we'll see I am running the script right now): https://ai.google.dev/gemma/docs/core/huggingface_text_finetune_qlora