This is broken with Unsloth stable (and the unstable build is broken anyway)
#5 opened 9 months ago
		by
		
				
							
						Ransom
	
RAM requirements for running Llama-3.3-70B-Instruct-Q5_K_M.gguf
									1
	#4 opened 10 months ago
		by
		
				
							
						hyadav22
	
Ollama run command doesn't works
➕
							
						6
				
								1
#3 opened 11 months ago
		by
		
				
							
						babakgh
	
can vllm launch this model?
									5
	#2 opened 11 months ago
		by
		
				
							
						chopin1998
	
It is quant of your own finetuned or original model?
									6
	#1 opened 11 months ago
		by
		
				
							
						supercharge19