Error in loading completely fine-tuned (all 7B parameters updated)
#106
by
shriML
- opened
I have done complete fine tuning of Mistral 7B Instruct v2 model. I am facing error while loading the model. I have attached the screenshot. Please suggest a way to resolve this error. I have used FSDP to train the model.
hey @shriML you might find Impulse AI (https://www.impulselabs.ai/) useful. we make it super easy to fine-tune and deploy open source models. hopefully you find it helpful! i know not relevant to your problem above but might be easier to use us to fine tune and deploy
docs: https://docs.impulselabs.ai/introduction
python sdk: https://pypi.org/project/impulse-api-sdk-python/