Haoyuan WU
hywu
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
1 day ago
Knocking-Heads Attention
authored
a paper
24 days ago
One-Token Rollout: Guiding Supervised Fine-Tuning of LLMs with Policy
Gradient
upvoted
a
paper
26 days ago
One-Token Rollout: Guiding Supervised Fine-Tuning of LLMs with Policy
Gradient
Organizations
None yet
-
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
Paper • 2401.02731 • Published • 3 -
hywu/Camelidae-8x7B
Text Generation • Updated • 672 • 15 -
hywu/Camelidae-8x13B
Text Generation • Updated • 668 • 5 -
hywu/Camelidae-8x34B
Text Generation • Updated • 936 • 29
-
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
Paper • 2401.02731 • Published • 3 -
hywu/Camelidae-8x7B
Text Generation • Updated • 672 • 15 -
hywu/Camelidae-8x13B
Text Generation • Updated • 668 • 5 -
hywu/Camelidae-8x34B
Text Generation • Updated • 936 • 29
datasets
0
None public yet