smolvlm

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, and more.

A CPU Realtime VLM in 500M. Surpassed Moondream2 and SmolVLM. Training from scratch with ease.

🎭 Real-time voice-controlled 3D avatar with multimodal AI - speak naturally and watch your AI companion respond with perfect lip-sync

Finetune VLM for Image classification in specific fields

Real-time webcam demo using SmolVLM with vLLM backend

This repository contains the implementation of AlignVLM paper, which proposes a novel method for vision language alignment

SmolVLM2 on the RK3588 NPU

A small VLM that sees everything

SmolVLM2 on the RK3588 NPU

𝗜𝗺𝗮𝗴𝗲 𝗖𝗮𝗽𝘁𝗶𝗼𝗻𝗶𝗻𝗴 𝘄𝗶𝘁𝗵 𝗢𝗰𝗰𝗹𝘂𝘀𝗶𝗼𝗻 𝗔𝗻𝗮𝗹𝘆𝘀𝗶𝘀 | 𝗩𝗶𝗧-𝗚𝗣𝗧𝟮 | 𝗦𝗺𝗼𝗹𝗩𝗟𝗠 | 𝗕𝗘𝗥𝗧

A full-stack ChatGPT-like application built (almost) from scratch

SmolVLM2 on the RK3588 NPU

⭐ Comparing VLMs with CNNs for garbage classification

Scripts for combining SmolVLM and LLM

Tool for multi-modal recommendation

Build and run powerful offline AI models on Android using Termux, llama.cpp, Qwen2.5-Coder, and SmolVLM. Complete beginner-friendly guide with step-by-step documentation.

Real-time vision demo using SmolVLM with llama.cpp backend

Streamlit application for generating and editing images using Black Forest Labs FLUX.2 Klein on Apple Silicon with MLX.

Receipt OCR using Fine-tuned VLMs

LoRA-fine-tuned SmolVLM for robust document question answering with corruption-based evaluation and Gradio deployment.