Download and run the model
#74
by HAAR - opened
How can I download this model and run it? Please help.
- download: try "git clone https://huggingface.co/bigscience/bloom".
- about inference, reference here. https://github.com/bigscience-workshop/Megatron-DeepSpeed/tree/main/scripts/inference
if you want every thing go smoothly, better get a machine with 8 x A100 (80GB), or you would get a lot of work to do.
If there were more details about it I would like to see it in the comments. Thank you very much for the information.
page not found. im also finding it hard to download
I think it's a typo from @pohunghuang but those are the ressources:
git clone https://huggingface.co/bigscience/bloom- inference (moved to another repo): https://github.com/huggingface/transformers-bloom-inference/tree/main/bloom-inference-scripts
what size is the bloom model? How many gigabytes do I need to install the model?