iVideoGPT
Collection
10 items • Updated • 1
How to use thuml/ivideogpt-oxe-64-act-free-medium with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("thuml/ivideogpt-oxe-64-act-free-medium", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]Pre-trained model introduced in the paper iVideoGPT: Interactive VideoGPTs are Scalable World Models.
See https://github.com/thuml/iVideoGPT for examples for using this model.
@inproceedings{wu2024ivideogpt,
title={iVideoGPT: Interactive VideoGPTs are Scalable World Models},
author={Jialong Wu and Shaofeng Yin and Ningya Feng and Xu He and Dong Li and Jianye Hao and Mingsheng Long},
booktitle={Advances in Neural Information Processing Systems},
year={2024}
}