The database of free AI tools on GitHub

Runs large language models on low VRAM GPUs.

A fast, lightweight inference engine for language models.

Self-host any open-source LLM as an OpenAI-compatible API server.

Run local AI apps and models on your GPU and NPU.

Rust-based OpenAI-compatible inference server for GGUF models.

Serve Qwen models on consumer GPUs with vLLM optimizations.

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.