Instructions to use FinGPT/fingpt-forecaster_dow30_llama2-7b_lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use FinGPT/fingpt-forecaster_dow30_llama2-7b_lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("base_models/Llama-2-7b-chat-hf") model = PeftModel.from_pretrained(base_model, "FinGPT/fingpt-forecaster_dow30_llama2-7b_lora") - Notebooks
- Google Colab
- Kaggle
error when running tokenizer for inference sample code
#3
by DiggingLace - opened
OSError: FinGPT/fingpt-forecaster_dow30_llama2-7b_lora does not appear to have a file named config.json. Checkout 'https://huggingface.co/FinGPT/fingpt-forecaster_dow30_llama2-7b_lora/main' for available files.
at tokenizer = AutoTokenizer.from_pretrained('FinGPT/fingpt-forecaster_dow30_llama2-7b_lora')
Why?
I have a same problem.
Did you solve it?
Please, can you share the solution?
Many thanks!
It seems like the tokenizer wasn't uploaded to the model.
But you can use the Tokenizer from the Base Llama model, as the tokenizer hasn't been modified.
You'll just need to do:tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-chat-hf")
amayuelas changed discussion status to closed