Improve model card: add sample usage and update library tag

README.md

@@ -1,21 +1,17 @@
 ---
-license: apache-2.0
 base_model:
 - Qwen/Qwen2.5-7B-Instruct
+library_name: transformers
+license: apache-2.0
 pipeline_tag: any-to-any
-library_name: bagel-mot
 ---
 
-
 <p align="left">
   <img src="https://lf3-static.bytednsdoc.com/obj/eden-cn/nuhojubrps/banner.png" alt="BAGEL" width="480"/>
 </p>
 
-
 # 🥯 BAGEL • Unified Model for Multimodal Understanding and Generation
 
-
-
 <p align="left">
   <a href="https://bagel-ai.org/">
     <img
@@ -51,21 +47,55 @@ library_name: bagel-mot
   
 </p>
 
-
 > We present **BAGEL**, an open‑source multimodal foundation model with 7B active parameters (14B total) trained on large‑scale interleaved multimodal data. BAGEL outperforms the current top‑tier open‑source VLMs like Qwen2.5-VL and InternVL-2.5 on standard multimodal understanding leaderboards, and delivers text‑to‑image quality that is competitive with strong specialist generators such as SD3.
-Moreover, BAGEL demonstrates superior qualitative results in classical image‑editing scenarios than the leading open-source models. More importantly, it extends to free-form visual manipulation, multiview synthesis, and world navigation, capabilities that constitute "world-modeling" tasks beyond the scope of previous image-editing models.
+Moreover, BAGEL demonstrates superior qualitative results in classical image‑editing scenarios than the leading open-source models. More importantly, it extends to free-form visual manipulation, multiview synthesis, 3D manipulation, and world navigation, capabilities that constitute "world-modeling" tasks beyond the scope of previous image-editing models.
 
 
 This repository hosts the model weights for **BAGEL**. For installation, usage instructions, and further documentation, please visit our [GitHub repository](https://github.com/bytedance-seed/BAGEL).
 
+<p align="left"><img src="https://github.com/ByteDance-Seed/Bagel/raw/main/assets/teaser.webp" width="80%"></p>
 
+## Usage
 
-<p align="left"><img src="https://github.com/ByteDance-Seed/Bagel/raw/main/assets/teaser.webp" width="80%"></p>
+Here's how to use BAGEL for multimodal inference:
+
+```python
+import torch
+from transformers import AutoProcessor, AutoModelForCausalLM
+from PIL import Image
+import requests
+
+# Load model and processor
+model_id = "bytedance-seed/BAGEL"
+processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
+model = AutoModelForCausalLM.from_pretrained(
+    model_id,
+    torch_dtype=torch.bfloat16,
+    device_map="auto",
+    trust_remote_code=True,
+)
+
+# Example: Multimodal input (image and text)
+# Load an image (e.g., from a URL or local path)
+image_url = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/transformers/tasks/bee.JPG"
+image = Image.open(requests.get(image_url, stream=True).raw)
 
+query = "What is in this image?"
 
+messages = [
+    {"role": "user", "content": [{"type": "image", "image": image}, {"type": "text", "text": query}]}
+]
 
+# Apply chat template and prepare inputs
+text = processor.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
+inputs = processor(text=text, images=image, return_tensors="pt").to(model.device)
 
+# Generate response
+generated_ids = model.generate(**inputs, max_new_tokens=100)
+response = processor.batch_decode(generated_ids, skip_special_tokens=True)[0]
 
+print(response)
+```
 
 ## 🧠 Method
 BAGEL adopts a Mixture-of-Transformer-Experts (MoT) architecture to maximize the model’s capacity to learn from richly diverse multimodal information. Following the same principle of capacity maximization, it utilizes two separate encoders to capture pixel-level and semantic-level features of an image. The overall framework follows a Next Group of Token Prediction paradigm, where the model is trained to predict the next group of language or visual tokens as a compression target.
@@ -74,14 +104,11 @@ BAGEL scales MoT’s capacity through Pre-training, Continued Training, and Supe
 
 <p align="left"><img src="https://github.com/ByteDance-Seed/Bagel/raw/main/assets/arch.png" width="50%"></p>
 
-
 ## 🌱 Emerging Properties
 <p align="left"><img src="https://github.com/ByteDance-Seed/Bagel/raw/main/assets/emerging_curves.png" width="50%"></p>
 
 As we scale up BAGEL’s pretraining with more multimodal tokens, we observe consistent performance gains across understanding, generation, and editing tasks. Different capabilities emerge at distinct training stages—multimodal understanding and generation appear early, followed by basic editing, while complex, intelligent editing emerges later. This staged progression suggests an emergent pattern, where advanced multimodal reasoning builds on well-formed foundational skills. Ablation studies further show that combining VAE and ViT features significantly improves intelligent editing, underscoring the importance of visual-semantic context in enabling complex multimodal reasoning and further supporting its role in the emergence of advanced capabilities.
 
-
-
 ## 📊 Benchmarks
 ### 1. Visual Understanding
 | Model | MME ↑ | MMBench ↑ |   MMMU ↑ | MM-Vet ↑ | MathVista ↑ |