When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
Paper
•
2411.13476
•
Published
•
16
•
2
Haonan Wang
haonan3
AI & ML interests
None yet
Recent Activity
upvoted
an
article
about 1 month ago
Decoding Strategies in Large Language Models
upvoted
a
paper
about 1 month ago
Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights
published
a dataset
about 2 months ago
haonan3/MINERVA
Organizations
commented
a
paper
8 months ago