LFM2-1.2B-GGUF

LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-1.2B

🏃 How to run LFM2

Example usage with llama.cpp:

llama-cli -hf LiquidAI/LFM2-1.2B-GGUF

Downloads last month: 22,015

GGUF

Model size

1.17B params

Architecture

lfm2

Hardware compatibility

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for LiquidAI/LFM2-1.2B-GGUF

Base model

LiquidAI/LFM2-1.2B

Quantized

(11)

this model

Collection including LiquidAI/LFM2-1.2B-GGUF

💧 LFM2

Collection

LFM2 is a new generation of hybrid models, designed for on-device deployment. • 15 items • Updated 9 days ago • 78