Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
chenhunghan
/
SmolLM2-FT-DPO
like
0
Text Generation
Transformers
Safetensors
llama
Generated from Trainer
smol-course
module_1
chenhunghan
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
main
SmolLM2-FT-DPO
543 MB
1 contributor
History:
2 commits
chenhunghan
End of training
2ba5147
verified
11 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
Safe
2.46 kB
End of training
11 months ago
config.json
Safe
937 Bytes
End of training
11 months ago
generation_config.json
Safe
132 Bytes
End of training
11 months ago
merges.txt
Safe
466 kB
End of training
11 months ago
model.safetensors
538 MB
xet
End of training
11 months ago
special_tokens_map.json
Safe
541 Bytes
End of training
11 months ago
tokenizer.json
Safe
3.52 MB
End of training
11 months ago
tokenizer_config.json
Safe
3.76 kB
End of training
11 months ago
training_args.bin
pickle
Detected Pickle imports (10)
"torch.device"
,
"trl.trainer.dpo_config.FDivergenceType"
,
"trl.trainer.dpo_config.DPOConfig"
,
"transformers.training_args.OptimizerNames"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_utils.HubStrategy"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.trainer_utils.SchedulerType"
,
"accelerate.state.PartialState"
,
"transformers.trainer_utils.IntervalStrategy"
How to fix it?
6.07 kB
xet
End of training
11 months ago
vocab.json
Safe
801 kB
End of training
11 months ago