gsaltintas commited on
Commit
8512714
·
verified ·
1 Parent(s): 5ae36ec

Upload tokenizer file tiktoken--gpt-4o.yaml

Browse files
Files changed (1) hide show
  1. tiktoken--gpt-4o.yaml +4 -0
tiktoken--gpt-4o.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ data:
2
+ tokenizer:
3
+ name: tiktoken
4
+ path: gpt-4o