A Survey on Efficient Inference for Large Language Models Paper • 2404.14294 • Published Apr 22, 2024 • 3
FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models Paper • 2501.01986 • Published Dec 30, 2024 • 1
R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Token Routing Paper • 2505.21600 • Published May 27 • 71
MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression Paper • 2406.14909 • Published Jun 21, 2024 • 16
FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs Paper • 2401.03868 • Published Jan 8, 2024 • 1