Chenyang Song

Raincleared's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 4 papers 14 days ago

ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Paper • 2309.14763 • Published Sep 26, 2023 • 1

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs

Paper • 2402.03804 • Published Feb 6, 2024 • 4

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models

Paper • 2402.13516 • Published Feb 21, 2024 • 1

BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity

Paper • 2507.08771 • Published 18 days ago • 9

upvoted a paper 16 days ago

BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity

Paper • 2507.08771 • Published 18 days ago • 9

commented a paper 16 days ago

BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity

Paper • 2507.08771 • Published 18 days ago • 9 •

1

updated 6 models 16 days ago

SparseLLM/BlockFFN-Small

Text Generation • Updated 16 days ago • 9

SparseLLM/BlockFFN-Medium

Text Generation • Updated 16 days ago • 10

SparseLLM/BlockFFN-Large

Text Generation • Updated 16 days ago • 9

SparseLLM/BlockFFN-XLarge

Text Generation • Updated 16 days ago • 11

SparseLLM/BlockFFN-3B-SFT-EAGLE

Text Generation • Updated 16 days ago • 9

SparseLLM/BlockFFN-3B-SFT

Text Generation • Updated 16 days ago • 18 • 1

published 6 models 22 days ago

SparseLLM/BlockFFN-Small

Text Generation • Updated 16 days ago • 9

SparseLLM/BlockFFN-Medium

Text Generation • Updated 16 days ago • 10

SparseLLM/BlockFFN-Large

Text Generation • Updated 16 days ago • 9

SparseLLM/BlockFFN-XLarge

Text Generation • Updated 16 days ago • 11

SparseLLM/BlockFFN-3B-SFT-EAGLE

Text Generation • Updated 16 days ago • 9

SparseLLM/BlockFFN-3B-SFT

Text Generation • Updated 16 days ago • 18 • 1

upvoted a collection about 2 months ago

MiniCPM4

Collection

MiniCPM4: Ultra-Efficient LLMs on End Devices • 22 items • Updated Jun 22 • 70

upvoted a paper 3 months ago

The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs

Paper • 2504.17768 • Published Apr 24 • 14