multi-modal-learning
Chinese-CLIP
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
- 6.1k
- Jupyter Notebook
- MIT
- 8 mo ago
x-clip
A concise but complete implementation of CLIP with various experimental improvements from recent papers
- 726
- Python
- MIT
- 3 wk ago
EmbodiedScan
[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI
- 680
- Python
- Apache-2.0
- 18 mo ago
awesome-visual-question-answering
A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.
- 675
- 3 y ago
CVPR-2023-24-Papers
CVPR 2023-2024 Papers: Dive into advanced research presented at the leading computer vision conference. Keep up to date with the latest developments in computer vision and deep learning. Code included. ⭐ support visual intelligence development!
- 453
- Python
- MIT
- 2 y ago
Multimodal-Remote-Sensing-Toolkit
A python tool to perform deep learning experiments on multimodal remote sensing data.
- 98
- Python
- GPL-3.0
- 5 y ago
TRAR-VQA
[ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"
- 68
- Python
- MIT
- 5 y ago
uavm
Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
- 59
- Python
- BSD-2-Clause
- 4 y ago
HGCLIP
[COLING'25] HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding
- 47
- Python
- MIT
- 24 mo ago
SAM-SLR-v2
SAM-SLR-v2 is an improved version of SAM-SLR for sign language recognition.
- 41
- Python
- CC0-1.0
- 5 y ago
EKR
Elysium Knowledge Repository is an open source initiative to embed all of Humanity's multi-modal knowledge and wisdom.
- 11
- Python
- Apache-2.0
- 3 y ago
ST-F2M
Official Code for Spatio-Temporal Fuzzy-oriented Multi-modal Meta-learning for Fine-grained Emotion Recognition
- 7
- Python
- 3 y ago
metadata-augmented-neural-networks-for-wild-animal-classification
This repository contains the implementation code for the paper "Metadata Augmented Neural Networks For Wild Animal Classification": https://www.sciencedirect.com/science/article/pii/S1574954124003479.
- 2
- Jupyter Notebook
- MIT
- 2 y ago
Do_Cross_Modal_Systems_Leverage_Semantic_Relationships
This is the code for our ICCV'19 paper on cross-modal learning and retrieval.
- 1
- MIT
- 6 y ago











