zilliztech/GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
- Stars
- 8.2k
- Forks
- 597
- Open issues
- 75
- Last push
- 1mo ago
About GPTCache
GPTCache is a free, open-source LLM chat app by zilliztech, written mainly in Python. Semantic cache for LLMs. Fully integrated with LangChain and llama_index. It has 8.2k GitHub stars and 597 forks, and was last updated 1mo ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Python
- Stars
- 8,213
- Last update
- 1mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Yes
Similar free tools
gpt4free67k stars · The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3
one-api37k stars · LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key
GPT_API_free45k stars · 免费大模型API，支持免费调用GPT、DeepSeek等主流模型，免费额度10000点，每日刷新！另付费价格最低官方1-2折！
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
gorilla13k stars · Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
GPTCache FAQ
Is GPTCache free?
GPTCache is open source, but it needs a paid third-party API key to work. It's released under the MIT license, a standard open-source license.
Does GPTCache run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does GPTCache need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is GPTCache still maintained?
It was last updated 1mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to GPTCache?
Similar free, open-source tools include gpt4free, one-api, GPT_API_free, open-webui.