Uploaded model
- Developed by: ricostaedeli
- License: apache-2.0
- Finetuned from model : ricostaedeli/Meta-Llama-3.1-1B-Instruct_SFT_2
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for ricostaedeli/Meta-Llama-3.1-8B-Instruct_SFT_DPO-lora
Base model
ricostaedeli/Meta-Llama-3.1-8B-Instruct_SFT