diffsketcher / tokenizer.json
jree423's picture
Upload tokenizer.json with huggingface_hub
3657839 verified
raw
history blame
144 Bytes
{
"version": "1.0",
"model_type": "clip",
"bos_token": "<|startoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}