ferrumox/fox
A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefill
- Stars
- 190
- Forks
- 28
- Open issues
- 4
- Last push
- 2mo ago
fox star history
-1 this week
About fox
fox is a free, open-source LLM chat app by ferrumox, written mainly in Rust. A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefill. It has 190 GitHub stars and 28 forks, and was last updated 2mo ago. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to the project, it works on macOS.
- License
- Not detected
- Commercial use
- No license
- Language
- Rust
- Stars
- 190
- Last update
- 2mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
ollama185k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Vane38k stars · Privacy-focused AI-powered answering engine with local and cloud LLM support.
one-api37k stars · 统一管理多个大语言模型API，提供二次分发服务。
web-llm19k stars · Runs language models in web browsers for AI chatbots and assistants.
open-webui157k stars · Self-hosted AI platform for managing and integrating various language models.
textgen48k stars · Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
fox FAQ
Can I use fox commercially?
Unclear. No license was detected, which legally means all rights are reserved. Ask the author before using it commercially. This is a plain-English summary, not legal advice.
Is fox free?
Yes. fox is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does fox run on a Mac?
Yes. According to the project, fox works on macOS.
Does fox need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is fox still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to fox?
Similar free, open-source tools include ollama, Vane, one-api, web-llm.
Maintain fox?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/ferrumox/fox)