Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Gapeleon
/
bytedance_BAGEL-7B-MoT-INT8

Any-to-Any
Transformers
quantized
bagel
mot
int8
Model card Files Files and versions
xet
Community
4

Instructions to use Gapeleon/bytedance_BAGEL-7B-MoT-INT8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use Gapeleon/bytedance_BAGEL-7B-MoT-INT8 with Transformers:

    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("Gapeleon/bytedance_BAGEL-7B-MoT-INT8", dtype="auto")
  • Notebooks
  • Google Colab
  • Kaggle
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Thank you for your work. How should this model be used? Do you have code? How much VRAM is needed to run and how long does it take to reason once

❤️ 1
1
#3 opened about 1 year ago by
michaelj
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs