Hugging Face's logo

mistralai
/
Devstral-Small-2505

Safetensors
vllm
mistral
mistral-common
Model card Files
xet
Community
26

add regular tokenizer

#8
by michaelfeil - opened
base: refs/heads/main
←
from: refs/pr/8
Discussion Files changed
+9024
-0
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. tokenizer.json +3 -0
  3. tokenizer_config.json +0 -0
.gitattributes CHANGED
@@ -40,3 +40,4 @@ assets/tuto_open_hands/agent_working.png filter=lfs diff=lfs merge=lfs -text
40
  assets/tuto_open_hands/build_app.png filter=lfs diff=lfs merge=lfs -text
41
  assets/tuto_open_hands/agent_prompting.png filter=lfs diff=lfs merge=lfs -text
42
  assets/tuto_open_hands/app_ui.png filter=lfs diff=lfs merge=lfs -text
 
 
40
  assets/tuto_open_hands/build_app.png filter=lfs diff=lfs merge=lfs -text
41
  assets/tuto_open_hands/agent_prompting.png filter=lfs diff=lfs merge=lfs -text
42
  assets/tuto_open_hands/app_ui.png filter=lfs diff=lfs merge=lfs -text
43
+ tokenizer[[:space:]](1).json filter=lfs diff=lfs merge=lfs -text
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b76085f9923309d873994d444989f7eb6ec074b06f25b58f1e8d7b7741070949
3
+ size 17078037
tokenizer_config.json ADDED
The diff for this file is too large to render. See raw diff