Simon Mo's picture

12 3 1

Simon Mo

simon-mo

·

https://github.com/simon-mo

AI & ML interests

System for ML

Recent Activity

reacted to erikkaum's post with 🤗 12 days ago

We just released native support for @SGLang and @vllm-project in Inference Endpoints 🔥 Inference Endpoints is becoming the central place where you deploy high performance Inference Engines. And that provides the managed infra for it. Instead of spending weeks configuring infrastructure, managing servers, and debugging deployment issues, you can focus on what matters most: your AI model and your users 🙌

new activity 3 months ago

Qwen/Qwen3-0.6B-FP8:Remove vLLM FP8 Limitation

new activity 3 months ago

Qwen/Qwen3-1.7B-FP8:Remove vLLM FP8 Limitation

View all activity

Organizations

models 0

None public yet

datasets 0

None public yet