Taehyeon Kim's picture

2 13 2

Taehyeon Kim

Kthyeon

·

https://taehyeon.oopy.io/

AI & ML interests

LLM Inference: Parallel, Speculative, Instructive Decoding

Recent Activity

upvoted a paper 13 days ago

EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes

upvoted a paper 14 days ago

Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation

upvoted a paper 2 months ago

Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness

View all activity

Organizations

New activity in microsoft/Phi-3-small-8k-instruct 9 months ago

Getting the error: "triton.runtime.autotuner.OutOfResources: out of resource: shared memory, Required: 180224, Hardware limit: 166912. Reducing block sizes or `num_stages` may help."

#27 opened about 1 year ago by

commented a paper about 1 year ago

Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters

Paper • 2406.16758 • Published Jun 24, 2024 • 20 •