OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
Paper
•
2402.01739
•
Published
•
29
Zheng Zian(Andy)
OrionZheng
AI & ML interests
LLM, Mixture-of-Experts, Data-Centric AI
Recent Activity
liked
a dataset
6 days ago
TIGER-Lab/VisCode-200K
upvoted
a
paper
6 days ago
VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code
Generation
new activity
about 2 months ago
OrionZheng/openmoe-8b:error in modeling_openmoe.py
Organizations
None yet
authored
2
papers
9 months ago