huggingface_hub>=0.23.4
accelerate
torch==2.4.0
transformers
sentencepiece
bitsandbytes
Pillow
protobuf
gguf
numpy<2.0.0
peft>=0.12.0
torchvision
pydantic==2.10.6