Models

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24 • 11 • 1

bartowski/Llama-3.3-70B-Instruct-exl2

Text Generation • Updated Dec 20, 2024 • 24 • 3

etemiz/Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 19, 2024 • 42

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 11B • Updated Jan 3 • 12

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • 71B • Updated Jan 3 • 13

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF

Text Generation • 71B • Updated Jan 19 • 15

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 19

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 50

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19 • 25

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

Text Generation • 71B • Updated Jan 19 • 169

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 24

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 355 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF

Text Generation • 71B • Updated Jan 19 • 28

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 37

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 65

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • 71B • Updated Jan 19 • 41

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

Text Generation • 71B • Updated Jan 19 • 29

tensorblock/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 9 • 219

context-labs/neuralmagic-llama-3.1-70b-instruct-FP8

Text Generation • 71B • Updated Feb 24 • 8

necva/replicate-IEPile-Llama3.1-70B

37B • Updated Mar 10 • 10

necva/replica-IEPile-Llama3.1-70B

37B • Updated Mar 10 • 7

turboderp/Llama-3.1-70B-Instruct-exl3

Updated Nov 1 • 35 • 1

jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP

11B • Updated Jun 19 • 9

jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP

15B • Updated Jun 19 • 7

jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP

19B • Updated Jun 19 • 7

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated 18 days ago • 285

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30 • 9

Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant

36B • Updated Sep 30 • 7

TevunahAi/Llama-3.1-70B-Instruct-Ultra-Hybrid

Text Generation • 22B • Updated 5 days ago • 35