Post
182
🚀 We recently released any-llm: https://github.com/mozilla-ai/any-llm
🧑💻 It's easy to get started:
📖 Read more about it here: https://huggingface.co/blog/mozilla-ai/introducing-any-llm
🧑💻 It's easy to get started:
from any_llm import completion
import os
# Make sure you have the appropriate environment variable set
assert os.environ.get('MISTRAL_API_KEY')
# Basic completion
response = completion(
model="mistral/mistral-small-latest", # <provider_id>/<model_id>
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)📖 Read more about it here: https://huggingface.co/blog/mozilla-ai/introducing-any-llm