The database of free AI tools on GitHub
23,066 open-source AI repos. Find a free alternative to any paid AI tool, or see what developers are talking about.
127 repos · showing 1–30
🦍 The API and AI Gateway
Runs large language models on low VRAM GPUs.
Automatically recommends LLM models based on hardware capabilities.
Run LLMs and speech-to-text models with a single-file executable.
Compile and deploy large language models on various platforms.
A fast, in-process vector database for similarity search.
Builds knowledge-based local AI applications with small, specialized models.
Provides Python bindings for llama.cpp inference engine.
Automates Kubernetes cluster management with AI diagnostics.
AI search and vector database platform for large-scale data.
Edge AI inference engine for mobile devices and wearables.
Run local AI apps and models on your GPU and NPU.
Rust-based OpenAI-compatible inference server for GGUF models.
WebGPU components for React, Vue, Svelte, Solid, JS & Framer
Deploy and serve text embeddings models for high-performance inference.
Bulk port forwarding Kubernetes services for local development.
Run LLMs like LLaMA on local devices with C#/.NET.
DeepSeek v4.1 flash 逆向工具（无限五代） 求 Star 收藏 ⭐欢迎大家提交项目的改进
Offline Gemini image watermark restoration with reverse alpha blending. Native C++ GUI/CLI, batch processing, and optional GPU denoise.
Accelerate LLM inference by clustering home devices.
Simplifies local AI model serving and inference through containerization.
Runs large language models locally on Mac with high speed and efficiency.
Orchestrate data, pipelines, and models for AI applications.
Unified orchestration for AI compute across clouds and clusters.
Run AI models locally with node.js bindings for llama.cpp.
Model Context Protocol (MCP) server for Kubernetes and OpenShift
Inference Llama 2 in one file of pure 🔥
kubewall - Kubernetes Dashboard for Multi-Cluster Management Real-Time, Self-Hosted, Single Binary, AI-powered. Manage, monitor & debug K8s clusters in your browser, no cloud, no agents.
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
Community maintained hardware plugin for vLLM on Apple Silicon