BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining
Paper • 2508.10975 • Published • 60
Anshuman Suri
iamgroot42
AI & ML interests
Privacy, Distribution Inference, Membership Inference
Recent Activity
liked a dataset about 13 hours ago
AlienKevin/SWE-ZERO-12M-trajectories liked a dataset 3 days ago
bigcode/the-stack-v2 liked a dataset 14 days ago
open-thoughts/AgentTroveOrganizations
upvoted a paper 6 months ago
upvoted 2
papers 7 months ago
upvoted 2
collections 7 months ago
upvoted an article 8 months ago
Article
Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers
- +5
ariG23498, sergiopaniego, reach-vb, pcuenq, ArthurZ, SaylorTwift, cyrilvallez
• • 188 upvoted a paper 9 months ago
upvoted a paper 10 months ago
upvoted 2
articles 10 months ago
Article
Navigating the RLHF Landscape: From Policy Gradients to PPO, GAE, and DPO for LLM Alignment
NormalUhr
• • 120 Article
SmolLM3: smol, multilingual, long-context reasoner
- +21
eliebak, cmpatino, anton-l, edbeeching, m-ric, nouamanetazi, akseljoonas, guipenedo, hynky, clefourrier, SaylorTwift, kashif, qgallouedec, hlarcher, glutamatt, Xenova, reach-vb, ngxson, craffel, lewtun, loubnabnl, lvwerra, thomwolf
• • 775 upvoted 2
papers about 1 year ago
upvoted 3
papers over 1 year ago
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper • 2502.02737 • Published • 258
Executable Code Actions Elicit Better LLM Agents
Paper • 2402.01030 • Published • 194
LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset
Paper • 2402.09391 • Published • 3