Distributed Speculative Inference of Large Language Models
Paper
•
2405.14105
•
Published
•
19
Jonathan Mamou
jmamou
AI & ML interests
None yet
Recent Activity
updated
a model
about 2 months ago
jmamou/Llama-3.2-1B_pruned
published
a model
about 2 months ago
jmamou/Llama-3.2-1B_pruned
published
an
article
4 months ago
Speeding Up LLM Decoding with Advanced Universal Assisted Generation Techniques
Organizations
authored
5
papers
about 1 year ago
ABSApp: A Portable Weakly-Supervised Aspect-Based Sentiment Extraction System
Paper
•
1909.05608
•
Published
Term Set Expansion based NLP Architect by Intel AI Lab
Paper
•
1808.08953
•
Published
•
1
Term Set Expansion based on Multi-Context Term Embeddings: an End-to-end Workflow
Paper
•
1807.10104
•
Published
•
1
Accelerating Speculative Decoding using Dynamic Speculation Length
Paper
•
2405.04304
•
Published
•
2