The database of free AI tools on GitHub
23,066 open-source AI repos. Find a free alternative to any paid AI tool, or see what developers are talking about.
11 repos · showing 1–11
Runs large language models on low VRAM GPUs.
A fast, lightweight inference engine for language models.
Self-host any open-source LLM as an OpenAI-compatible API server.
Run local AI apps and models on your GPU and NPU.
Rust-based OpenAI-compatible inference server for GGUF models.
Accelerates attention mechanisms in AI models without sacrificing accuracy.
Serve Qwen models on consumer GPUs with vLLM optimizations.
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
BentoDiffusion: A collection of diffusion models served with BentoML
MoE expert offload for low-VRAM GPUs — run 100B+ MoE models (DeepSeek, Qwen, Mixtral) on 8 GB cards. Expert cache with LRU hot experts, OpenAI-compatible proxy, GGUF multi-shard.