jia-gao/leanctx
Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your code. Python SDK, LLMLingua-2, MIT.
- Stars
- 322
- Forks
- 7
- Open issues
- 1
- Last push
- 2mo ago
About leanctx
leanctx is a free, open-source AI developer tool by jia-gao, written mainly in Python. Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your code. Python SDK, LLMLingua-2, MIT. It has 322 GitHub stars and 7 forks, and was last updated 2mo ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Python
- Stars
- 322
- Last update
- 2mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
langchain148k stars · The agent engineering platform.
prompt-optimizer39k stars · An AI prompt optimizer for writing better prompts and getting better AI results.
litellm62k stars · The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
openai-python32k stars · The official Python library for the OpenAI API
openai-cookbook77k stars · Examples and guides for using the OpenAI API
LangGPT13k stars · LangGPT: Empowering everyone to become a prompt expert! 🚀 📌 结构化提示词(Structured Prompt)提出者 📌 元提示词(Meta-Prompt)发起者 📌 最流行的提示词落地范式 | Language of GPT The pioneering framework for structured & meta-p
leanctx FAQ
Is leanctx free?
Yes. leanctx is open source and free to use. It's released under the MIT license, a standard open-source license.
Does leanctx run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does leanctx need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is leanctx still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to leanctx?
Similar free, open-source tools include langchain, prompt-optimizer, litellm, openai-python.