Models

microsoft/Phi-4-multimodal-instruct

Automatic Speech Recognition • 6B • Updated May 1 • 306k • 1.46k

Salesforce/blip2-opt-2.7b

Image-Text-to-Text • 4B • Updated Feb 3 • 733k • 403

dandelin/vilt-b32-finetuned-vqa

Visual Question Answering • Updated Aug 2, 2022 • 37.5k • 413

Salesforce/blip2-flan-t5-xl

Image-Text-to-Text • 4B • Updated Feb 3 • 200k • 82

google/pix2struct-docvqa-base

Visual Question Answering • 0.3B • Updated Dec 24, 2023 • 10.7k • 39

google/pix2struct-screen2words-large

Visual Question Answering • Updated May 19, 2023 • 493 • 20

ByteDance/shot2story

Visual Question Answering • Updated Jun 17, 2024 • 29

SakanaAI/TAID-VLM-2B

Visual Question Answering • 2B • Updated Jan 30 • 23 • 5

DavidLanz/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • 5B • Updated Mar 10 • 16 • 2

huihui-ai/Phi-4-multimodal-instruct-abliterated

Automatic Speech Recognition • 6B • Updated Mar 3 • 165 • 23

VLM-Reasoner/LMM-R1-MGT-PerceReason

Visual Question Answering • 4B • Updated Mar 13 • 2.94k • 3

LZXzju/Qwen2.5-VL-3B-UI-R1-E

Visual Question Answering • 4B • Updated May 18 • 950 • 4

azwierzc/vilt-b32-finetuned-vqa-pl

Visual Question Answering • Updated Mar 21, 2022 • 15

Bingsu/temp_vilt_vqa

Visual Question Answering • Updated Nov 28, 2022 • 8

microsoft/git-base-vqav2

Visual Question Answering • 0.2B • Updated Mar 9, 2024 • 221 • 19

microsoft/git-base-textvqa

Visual Question Answering • 0.2B • Updated Mar 29, 2024 • 1.05k • 6

Salesforce/blip-vqa-base

Visual Question Answering • 0.4B • Updated Feb 3 • 401k • 165

Salesforce/blip-vqa-capfilt-large

Visual Question Answering • Updated Feb 3 • 96.7k • 52

tufa15nik/vilt-finetuned-vqasi

Visual Question Answering • Updated Dec 15, 2022 • 11

microsoft/git-large-vqav2

Visual Question Answering • 0.4B • Updated Sep 7, 2023 • 2.19k • 18

microsoft/git-large-textvqa

Visual Question Answering • 0.4B • Updated Apr 9, 2024 • 290 • 4

ivelin/donut-refexp-combined-v1

Visual Question Answering • Updated Feb 7, 2023 • 12 • 4

tifa-benchmark/promptcap-coco-vqa

Image-to-Text • Updated Dec 11, 2023 • 135 • 12

sheldonxxxx/OFA_model_weights

Visual Question Answering • Updated Feb 8, 2023 • 1

Salesforce/blip2-opt-6.7b

Image-Text-to-Text • 8B • Updated Feb 3 • 4.9k • 78

Salesforce/blip2-opt-2.7b-coco

Image-to-Text • 4B • Updated Feb 3 • 56.4k • 9

Salesforce/blip2-opt-6.7b-coco

Image-Text-to-Text • 8B • Updated Feb 3 • 88.1k • 34

Salesforce/blip2-flan-t5-xl-coco

Image-to-Text • 4B • Updated Feb 3 • 1.67k • 16

Salesforce/blip2-flan-t5-xxl

Image-Text-to-Text • 12B • Updated Feb 3 • 7.39k • 92

google/pix2struct-widget-captioning-large

Visual Question Answering • 1B • Updated Apr 10, 2024 • 54 • 19