vlms

Open repos and models their makers tagged vlms, most starred first. The same for everyone.

AI on my own machineRepo

HallusionBench

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

  • 346
  • Python
  • BSD-3-Clause
  • 13 mo ago
tianyi-labTake it
Language and translationRepo

Tiny-VLMs-Lab

Tiny VLMs Lab is a Hugging Face Space and open-source project showcasing lightweight Vision-Language Models for image captioning, OCR, reasoning, and multimodal understanding. It offers a simple Gradio interface to upload images, query models, adjust generation settings, and export results in Markdown or PDF.

  • 8
  • Python
  • Apache-2.0
  • 12 mo ago
Images and videoRepo

Molmo2-HF-Demo

A Gradio-based demonstration for the AllenAI Molmo2-8B multimodal model, enabling image QA, multi-image pointing, video QA, and temporal tracking. Users upload images or videos, provide natural language prompts.

  • 4
  • Python
  • Apache-2.0
  • 6 mo ago
GitHubRepo

Multimodal-Edge-Node

Multimodal-Edge-Node is an experimental, node-based visual reasoning and multimodal inference canvas. It provides a unique, deeply customized web interface where users can visually connect input images, select from a diverse arsenal of 10 state-of-the-art vision-language models, define task parameters (such as query, caption, point, or detect).

  • 6
  • Python
  • Apache-2.0
  • 7 mo ago
AI on my own machineRepo

Complete-Multimodal-RAG

Multimodal Retrieval-Augmented Generation (RAG) learning repository covering text, images, tables, charts, and document retrieval. Explores multimodal embeddings, vision-language models, cross-modal search, document understanding, and context-aware answer generation for building intelligent multimodal AI applications using Python.

  • 3
  • Jupyter Notebook
  • GPL-3.0
  • 4 d ago
GitHubRepo

DREX

drex-062225-exp (document retrieval and extraction expert) model is a specialized fine-tuned version of docscopeocr-7b-050425-exp, optimized for document retrieval, content extraction, and analysis recognition. built on top of the qwen2.5-vl architecture.

  • 1
  • Python
  • Apache-2.0
  • 16 mo ago
Search GitHub and Hugging Face for vlms

Get , open it once and sign in. Then come back here and press the button again.

vlms: open source repos and models on Take My Repo