Transformers
PyTorch
megatron-bert
yonghuiwu commited on
Commit
f265cc3
·
verified ·
1 Parent(s): a0aca24

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -6
README.md CHANGED
@@ -24,12 +24,13 @@ We sampled the beginning 15 tokens from all sections of the de-identified notes
24
 
25
  <h2>Model variations</h2>
26
 
27
- Model | Parameter
28
- --- | ---
29
- [gatortron-base](https://huggingface.co/UFNLP/gatortron-base)| 345 million
30
- [gatortronS (this model)](https://huggingface.co/UFNLP/gatortronS) | 345 million
31
- [gatortron-medium](https://huggingface.co/UFNLP/gatortron-medium) | 3.9 billion
32
- [gatortron-large](https://huggingface.co/UFNLP/gatortron-large) | 8.9 billion
 
33
 
34
  <h2>How to use</h2>
35
 
 
24
 
25
  <h2>Model variations</h2>
26
 
27
+ Model | Parameter | Maximum input
28
+ --- | --- | ---
29
+ [gatortron-base-2k](https://huggingface.co/UFNLP/gatortron-base-2k) | 345 million | 2048
30
+ [gatortron-base](https://huggingface.co/UFNLP/gatortron-base) | 345 million | 512
31
+ [gatortronS (this model)](https://huggingface.co/UFNLP/gatortronS) | 345 million | 512
32
+ [gatortron-medium](https://huggingface.co/UFNLP/gatortron-medium) | 3.9 billion | 512
33
+ [gatortron-large](https://huggingface.co/UFNLP/gatortron-large) | 8.9 billion | 512
34
 
35
  <h2>How to use</h2>
36