SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs
Paper
•
2412.08347
•
Published
•
4
Sultan Alrashed PRO
SultanR
AI & ML interests
Smol language modelling!
Recent Activity
updated
a dataset
4 days ago
SultanR/smolkalam
new activity
4 days ago
SultanR/smolkalam:Upload preferred translations for split Mixture_of_Thoughts_science_no_think
Organizations
authored
a
paper
12 months ago
authored
3
papers
about 1 year ago
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Paper
•
2402.01781
•
Published
•
4
Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models
Paper
•
2411.06402
•
Published
•
2
ALLaM: Large Language Models for Arabic and English
Paper
•
2407.15390
•
Published
•
3