🪩 Create Disco Diffusion artworks in one line
Represent, send, store and search multimodal data
A collection of research on knowledge graphs
A curated list of different papers and datasets in various areas of audio-visual processing
PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)
Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.
Ultra-low bitrate speech codec (0.27-1 kbps) with cross-modal alignment and real-time capabilities
Remote Sensing Sar-Optical Land-use Classfication Pytorch Pytorch高分辨率遥感语义分割/地物分割/地物分类
[CVPR 2023] Referring Image Matting
BioT5 (EMNLP 2023) and BioT5+ (ACL 2024 Findings)
[NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP)
DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation (ICCV 2023)
Weakly Supervised 3D Object Detection from Point Clouds (VS3D), ACM MM 2020
Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning, CVPR 2022
This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .
Unofficial Implementation of Google Deepmind's paper `Objects that Sound`
Code for journal paper "Learning Dual Semantic Relations with Graph Attention for Image-Text Matching", TCSVT, 2020.
[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
AlignCLIP: Improving Cross-Modal Alignment in CLIP (ICLR 2025)
Unleash the Potential of Image Branch for Cross-modal 3D Object Detection [NeurIPS2023]
To associate your repository with the cross-modal topic, visit your repo's landing page and select "manage topics."