PowerInfer

community

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

models 29

PowerInfer/SmallThinker-21BA3B-Instruct-GGUF

Text Generation • 22B • Updated Aug 5 • 3.71k • 34

PowerInfer/SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Aug 5 • 761 • 30

PowerInfer/SmallThinker-21BA3B-Instruct

Text Generation • 22B • Updated Jul 31 • 113 • 109

PowerInfer/SmallThinker-4BA0.6B-Instruct

Text Generation • 4B • Updated Jul 31 • 223 • 52

PowerInfer/SmallThinker-4BA0.6B-Instruct-INT4-QAT

4B • Updated Jul 29 • 116 • 1

PowerInfer/SmallThinker-3B-Preview

Text Generation • 3B • Updated Jan 16 • 31.3k • 412

PowerInfer/SparseQwen2-7B

8B • Updated Dec 25, 2024 • 1 • 5

PowerInfer/TurboSparse-Mistral-Instruct

Feature Extraction • 8B • Updated Jun 14, 2024 • 20

PowerInfer/TurboSparse-Mixtral

Feature Extraction • 52B • Updated Jun 14, 2024 • 2 • 35

PowerInfer/TurboSparse-Mixtral-Instruct

Feature Extraction • 52B • Updated Jun 14, 2024 • 2 • 28

datasets 4

PowerInfer/PowerCoding

Preview • Updated Jul 27 • 305 • 2

PowerInfer/PowerMath

Preview • Updated Jul 27 • 13

PowerInfer/LONGCOT-Refine-500K

Viewer • Updated Jan 2 • 522k • 113 • 50

PowerInfer/QWQ-LONGCOT-500K

Viewer • Updated Dec 26, 2024 • 286k • 72 • 125