Ilyas Moutawwakil's picture

Ilyas Moutawwakil

IlyasMoutawwakil

AI & ML interests

Optimization, LLMs, Hardware, Backends, ..

Recent Activity

posted an update about 20 hours ago
๐Ÿš€ Optimum: The Last v1 Release ๐Ÿš€ Optimum v1.27 marks the final major release in the v1 series. As we close this chapter, we're laying the groundwork for a more modular and community-driven future: - Optimum v2: A lightweight core package for porting Transformers, Diffusers, or Sentence-Transformers to specialized AI hardware/software/accelerators.. - Optimumโ€‘ONNX: A dedicated package where the ONNX/ONNX Runtime ecosystem lives and evolves, faster-moving and decoupled from the Optimum core. ๐ŸŽฏ Why this matters: - A clearer governance path for ONNX, fostering stronger community collaboration and improved developer experience.. - Enable innovation at a faster pace in a more modular, open-source environment. ๐Ÿ’ก What this means: - More transparency, broader participation, and faster development driven by the community and key actors in the ONNX ecosystem (PyTorch, Microsoft, Joshua Lochner ๐Ÿ‘€, ...) - A cleaner, more maintainable core Optimum, focused on extending HF libraries to special AI hardware/software/accelerators tooling and used by our partners (Intel Corporation, Amazon Web Services (AWS), AMD, NVIDIA, FuriosaAI, ...) ๐Ÿ› ๏ธ Major updates I worked on in this release: โœ… Added support for Transformers v4.53 and SmolLM3 in ONNX/ONNXRuntime. โœ… Solved batched inference/generation for all supported decoder model architectures (LLMs). โœจ Big shoutout to @echarlaix for leading the refactoring work that cleanly separated ONNX exporter logic and enabled the creation of Optimumโ€‘ONNX. ๐Ÿ“ Release Notes: https://lnkd.in/gXtE_qji ๐Ÿ“ฆ Optimum : https://lnkd.in/ecAezNT6 ๐ŸŽ Optimum-ONNX: https://lnkd.in/gzjyAjSi #Optimum #ONNX #OpenSource #HuggingFace #Transformers #Diffusers
View all activity

Organizations

Hugging Face's profile picture Training Transformers Together's profile picture OpenVINO Toolkit's profile picture HugGAN Community's profile picture ONNXConfig for all's profile picture Hugging Face Optimum's profile picture HuggingFaceM4's profile picture Hugging Face H4's profile picture Optimum AMD's profile picture That Time I got Reincarnated as a Hugging Face Organization's profile picture AI Energy Score's profile picture Optimum-Benchmark's profile picture Social Post Explorers's profile picture Dev Mode Explorers's profile picture Optimum-Intel's profile picture ONNX Community's profile picture Hugging Face Machine Learning Optimization's profile picture Optimum Internal Testing's profile picture