mlx-community
/

Nanonets-OCR-s-6bit

Image-Text-to-Text

text-generation-inference

Model card Files Files and versions

mlx-community/Nanonets-OCR-s-6bit

This model was converted to MLX format from nanonets/Nanonets-OCR-s using mlx-vlm version 0.3.2. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model mlx-community/Nanonets-OCR-s-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>

Downloads last month: 61

Safetensors

Model size

1.34B params

Tensor type

BF16

·

U32

·

Inference Providers NEW

Image-Text-to-Text

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mlx-community/Nanonets-OCR-s-6bit

Base model

Qwen/Qwen2.5-VL-3B-Instruct

Quantized

(48)

this model

Collection including mlx-community/Nanonets-OCR-s-6bit

Nanonets OCR

This collection houses Nanonets-OCR-s • 7 items • Updated 3 days ago • 1