Data shuffled only at the document-level
BabyLM Sequence Length
community
AI & ML interests
BabyLM 2025 paper submission
Recent Activity
View all activity
models
50
babylm-seqlen/opt-2048-warmup-v2
0.1B
•
Updated
•
601
babylm-seqlen/mamba-2048-warmup-v2
0.2B
•
Updated
•
474
babylm-seqlen/mamba-64-warmup-v2
0.2B
•
Updated
•
411
babylm-seqlen/mamba-8192-warmup-v2
0.2B
•
Updated
•
410
babylm-seqlen/mamba-4096-warmup-v2
0.2B
•
Updated
•
410
babylm-seqlen/opt-8192-warmup-v2
0.1B
•
Updated
•
377
babylm-seqlen/opt-4096-warmup-v2
0.1B
•
Updated
•
374
babylm-seqlen/mamba-128-warmup-v2
0.2B
•
Updated
•
408
babylm-seqlen/mamba-512-warmup-v2
0.2B
•
Updated
•
412
babylm-seqlen/mamba-1024-warmup-v2
0.2B
•
Updated
•
410
datasets
18
babylm-seqlen/train_100M_64
Viewer
•
Updated
•
2.56M
•
5
babylm-seqlen/train_100M_512_single_shuffle
Viewer
•
Updated
•
319k
•
7
babylm-seqlen/train_100M_8192_single_shuffle
Viewer
•
Updated
•
19.8k
•
2
babylm-seqlen/train_100M_2048_single_shuffle
Viewer
•
Updated
•
79.8k
•
4
babylm-seqlen/train_100M_16384_single_shuffle
Viewer
•
Updated
•
9.86k
•
5
babylm-seqlen/train_100M_4096_single_shuffle
Viewer
•
Updated
•
39.8k
•
8
babylm-seqlen/train_100M_256_single_shuffle
Viewer
•
Updated
•
639k
•
2
babylm-seqlen/train_100M_1024_single_shuffle
Viewer
•
Updated
•
160k
•
2
babylm-seqlen/train_100M_128_single_shuffle
Viewer
•
Updated
•
1.28M
•
6
babylm-seqlen/train_100M_64_single_shuffle
Viewer
•
Updated
•
2.56M
•
4