FreeAIRepo
← By hardware

Free AI tools that run on a 16 GB GPU

Open-source AI tools that need 16 GB of GPU memory or less, a fit for cards like the RTX 4060 Ti 16 GB, 4070 Ti Super and 4080.

Updated · 139 tools

AI Image Generators & Editors

See all 38 →
AUTOMATIC1111/stable-diffusion-webui

A web UI for generating and editing images using Stable Diffusion.

165kupdated 7mo ago
Image generation & editing
Really freeCopyleft · AGPL-3.04 GB VRAMRuns on MacPython
Comfy-Org/ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.

143kupdated today
Image generation & editing#78 TRENDING
Copyleft · GPL-3.04 GB VRAMRuns on MacPython
lllyasviel/Fooocus

Generate images from text prompts with minimal effort.

54kupdated 10mo ago
Image generation & editing
Really freeCopyleft · GPL-3.04 GB VRAMCPU only OKPython
invoke-ai/InvokeAI

Generate and refine images using Stable Diffusion models.

29kupdated today
Image generation & editing
Really freeCommercial OK · Apache-2.08 GB VRAMRuns on MacCPU only OKTypeScript
Wan-Video/Wan2.2

Generates high-definition videos with advanced MoE architecture and aesthetic control.

18kupdated 1mo ago
Image generation & editing
Really freeCommercial OK · Apache-2.016 GB VRAMPython
modelscope/DiffSynth-Studio

Generates images, videos, and audio using Diffusion models.

13kupdated 3d ago
Image generation & editing
Really freeCommercial OK · Apache-2.04 GB VRAMPython

AI Voice & Speech Tools

See all 23 →
openai/whisper

Speech recognition model for multilingual transcription and translation.

111kupdated 1mo ago
Voice & audio
Really freeCommercial OK · MIT8 GB VRAMRuns on MacCPU only OKPython
CorentinJ/Real-Time-Voice-Cloning

Clone a voice in real-time for generating speech.

60kupdated 7mo ago
Voice & audio
No license2 GB VRAMRuns on MacCPU only OKPython
OpenBMB/VoxCPM

Generates high-quality multilingual speech from text.

41kupdated 18d ago
Voice & audio
Really freeCommercial OK · Apache-2.02 GB VRAMPython
SYSTRAN/faster-whisper

Transcribes audio faster than OpenAI Whisper with CTranslate2.

26kupdated 1d ago
Voice & audio
Really freeCommercial OK · MIT2 GB VRAMCPU only OKPython
DrewThomasson/ebook2audiobook

Convert e-books to audiobooks with text-to-speech and voice cloning.

20kupdated 20d ago
Voice & audio
Really freeCommercial OK · Apache-2.01 GB VRAMRuns on MacCPU only OKPython
SWivid/F5-TTS

Generates realistic speech using diffusion transformers and flow matching.

15kupdated 2d ago
Voice & audio
Really freeCommercial OK · MIT12 GB VRAMRuns on MacPython

AI Chat Apps & Local LLMs

See all 22 →
HandsOnLLM/Hands-On-Large-Language-Models

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

30kupdated 6mo ago
LLMs & chat
Commercial OK · Apache-2.016 GB VRAMJupyter Notebook
QwenLM/Qwen

Access and use Alibaba Cloud's Qwen large language models for chat and text generation.

22kupdated 7mo ago
LLMs & chat
Really freeCommercial OK · Apache-2.05.8 GB VRAMPython
xming521/WeClone

Create a digital avatar from chat history using fine-tuned LLMs.

18kupdated 4d ago
LLMs & chat
Really freeCopyleft · AGPL-3.016 GB VRAMPython
BlinkDL/RWKV-LM

RWKV-7 is a linear-time RNN language model for large-scale inference and chat applications.

15kupdated 27d ago
LLMs & chat
Really freeCommercial OK · Apache-2.07 GB VRAMPython
OpenMOSS/MOSS

An open-source conversational language model supporting Chinese and English.

12kupdated 1mo ago
LLMs & chat
Really freeCommercial OK · Apache-2.07.8 GB VRAMPython
BlinkDL/ChatRWKV

Open-source chatbot powered by RWKV RNN language model.

9.5kupdated 3mo ago
LLMs & chat
Really freeCommercial OK · Apache-2.03 GB VRAMCPU only OKPython

LLM Training & Fine-Tuning Tools

See all 14 →
modelscope/ms-swift

Fine-tune and deploy 600+ text and 400+ multimodal large language models.

16kupdated today
Training & fine-tuning
Really freeCommercial OK · Apache-2.09 GB VRAMPython
Jiayi-Pan/TinyZero

Reproduces DeepSeek R1-Zero for reinforcement learning in language models.

13kupdated 8mo ago
Training & fine-tuning
Really freeCommercial OK · Apache-2.04 GB VRAMPython
sapientinc/HRM

Trains and runs hierarchical reasoning models for complex tasks.

13kupdated 6mo ago
Training & fine-tuning
Really freeCommercial OK · Apache-2.04 GB VRAMPython
FareedKhan-dev/train-llm-from-scratch

Train large language models from scratch using PyTorch.

12kupdated 23d ago
Training & fine-tuning
Really freeCommercial OK · MIT1 GB VRAMCPU only OKPython
MakazhanAlpamys/Soup

Fine-tune LLMs with one command and minimal resources.

9.7kupdated 1d ago
Training & fine-tuning
Really freeCommercial OK · Apache-2.04 GB VRAMPython
arcee-ai/mergekit

Toolkit for merging pre-trained language models.

7.4kupdated 3d ago
Training & fine-tuning
Really freeWeak copyleft · LGPL-3.08 GB VRAMCPU only OKPython

AI Video Generators & Editors

See all 13 →
Wan-Video/Wan2.1

Generates high-quality videos using advanced AI models.

17kupdated 7mo ago
Video
Really freeCommercial OK · Apache-2.08.19 GB VRAMPython
PKU-YuanGroup/Open-Sora-Plan

Generates high-quality videos using AI models.

12kupdated 7mo ago
Video
Really freeCommercial OK · MIT16 GB VRAMPython
Lightricks/LTX-Video

Generate high-fidelity, synchronized audio+video from text or images.

11kupdated 9mo ago
Video
Really freeCommercial OK · Apache-2.016 GB VRAMPython
hao-ai-lab/FastVideo

Accelerated video generation framework for real-time inference.

4.7kupdated today
Video
Really freeCommercial OK · Apache-2.08 GB VRAMRuns on MacPython
antgroup/echomimic_v2

Generates human animations from audio inputs.

4.7kupdated 8mo ago
Video
Really freeCommercial OK · Apache-2.08 GB VRAMPython
Robbyant/lingbot-world

Generates high-fidelity video from text prompts.

4.5kupdated 3mo ago
Video
Really freeCommercial OK · Apache-2.04 GB VRAMPython

LLM Inference & Serving Tools

See all 11 →
lyogavin/airllm

Runs large language models on low VRAM GPUs.

41kupdated 1d ago
Inference & serving
Really freeCommercial OK · Apache-2.04 GB VRAMRuns on MacJupyter Notebook
GeeeekExplorer/nano-vllm

A fast, lightweight inference engine for language models.

16kupdated 6mo ago
Inference & serving
Really freeCommercial OK · MIT8 GB VRAMPython
bentoml/OpenLLM

Self-host any open-source LLM as an OpenAI-compatible API server.

13kupdated 3d ago
Inference & serving
Really freeCommercial OK · Apache-2.08 GB VRAMPython
lemonade-sdk/lemonade

Run local AI apps and models on your GPU and NPU.

6.0kupdated today
Inference & serving
Really freeCommercial OK · Apache-2.04 GB VRAMRuns on MacCPU only OKC++
Michael-A-Kuykendall/shimmy

Rust-based OpenAI-compatible inference server for GGUF models.

6.0kupdated 7d ago
Inference & serving
Really freeCommercial OK · Apache-2.04 GB VRAMRuns on MacRust
thu-ml/SageAttention

Accelerates attention mechanisms in AI models without sacrificing accuracy.

4.0kupdated 9mo ago
Inference & serving
Really freeCommercial OK · Apache-2.012 GB VRAMCuda

Computer Vision & OCR Tools

See all 8 →
NVlabs/instant-ngp

Real-time neural graphics primitives for NeRF, SDF, and image rendering.

18kupdated 8mo ago
Vision & OCR
No license4 GB VRAMCuda
YaoFANGUK/video-subtitle-extractor

提取视频中的硬字幕并生成srt文件。

9.6kupdated 6mo ago
Vision & OCR
Really freeCommercial OK · Apache-2.02 GB VRAMRuns on MacCPU only OKPython
koharu-rs/koharu

ML-powered manga translator with OCR and inpainting for local manga translation.

6.5kupdated today
Vision & OCR
Really freeCommercial OK · Apache-2.02 GB VRAMRuns on MacCPU only OKRust
nianticlabs/monodepth2

Trains and tests monocular depth estimation models using PyTorch.

4.5kupdated 21d ago
Vision & OCR
No license8 GB VRAMJupyter Notebook
TimmyOVO/deepseek-ocr.rs

Rust OCR engine with multiple backends and an OpenAI-compatible server.

2.2kupdated 8mo ago
Vision & OCR
Really freeCommercial OK · Apache-2.06.3 GB VRAMRuns on MacCPU only OKRust
th1nhhdk/local_ai_ocr

An local, offline (after initial setup), portable OCR software that can process images and PDF files, using DeepSeek-OCR-2 AI (running directly on your machine).

888updated 3mo ago
Vision & OCR
Really freeCommercial OK · Apache-2.08 GB VRAMPython

AI Agents & Automation Tools

See all 5 →
carla-simulator/carla

Simulator for developing and testing autonomous driving systems.

15kupdated today
Agents & automation
Really freeCommercial OK · MIT16 GB VRAMC++
Brain0-ai/brain0

The black box for AI-written code. Passive decision graph linking every commit to the agent prompts behind it: drift detection, DLP audit of what agents read, evidence-driven risk, MCP memory for codi

314updated 2d ago
Agents & automation
Really freeCommercial OK · Apache-2.04 GB VRAMRust
Private-Garden-Labs/garden-desk

Private AI on premise

248updated 3d ago
Agents & automation
Really freeCommercial OK · Apache-2.012 GB VRAMRuns on MacTypeScript
GabrieleLozupone/kokon

Edit photos by describing the change, on your own GPU. One installer, no Python, no cloud. Qwen-Image 2.1 for Windows and Mac, with an MCP server for AI agents.

219updated 1d ago
Agents & automation
Copyleft · AGPL-3.012 GB VRAMRuns on MacRust
ThomasHoussin/Claude-Book

A Multi-Agent Framework for Writing Novels with Claude Code

125updated 9mo ago
Agents & automation
Commercial OK · MIT16 GB VRAMPython

AI Coding Assistants

See all 3 →
drumih/turbo-fieldfare

Runs large language models on low-memory Macs using Swift and Metal.

7.0kupdated 11d ago
Coding assistants
Really freeCommercial OK · Apache-2.02 GB VRAMRuns on MacSwift
ggml-org/llama.vscode

VS Code extension for LLM-assisted code/text completion

1.6kupdated today
Coding assistants
Really freeCommercial OK · MIT16 GB VRAMRuns on MacTypeScript
timoncool/ACE-Step-Studio

Portable AI music generator — full songs with vocals, covers, music videos. One-click install, 100% offline, NVIDIA GPU.

442updated 1d ago
Coding assistants
Really freeCommercial OK · MIT4 GB VRAMTypeScript

FAQ

Which free AI tools that run on a 16 GB GPU?

We list 139 open-source AI tools in this group. The most popular are stable-diffusion-webui, ComfyUI, whisper, Real-Time-Voice-Cloning.

Are these tools really free?

Yes. They're open source and run on your own machine. Check each project's license before using it in a commercial product; the badge on each tool shows whether commercial use is allowed.

How do I know a tool fits my hardware?

Hardware details come from each project and can be incomplete. Check the project's install guide for exact requirements before you start.