Llama architecture, don't need any special Llama.cpp support, works out of the box.

GGUF

Model size

40B params

Architecture

llama

Hardware compatibility

4-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ilintar/IQuest-Coder-V1-40B-Instruct-GGUF

Base model

Quantized

(14)

this model