Distributed Speculative Inference of Large Language Models
Paper
•
2405.14105
•
Published
•
19
Nadav Timor
Nadav-Timor
AI & ML interests
None yet
Recent Activity
upvoted
an
article
20 days ago
Speeding Up LLM Decoding with Advanced Universal Assisted Generation Techniques
commented on
an
article
4 months ago
Speeding Up LLM Decoding with Advanced Universal Assisted Generation Techniques
commented on
their
article
4 months ago
Universal Assisted Generation: Faster Decoding with Any Assistant Model
Organizations
authored
a
paper
about 1 year ago
authored
a
paper
about 2 years ago