ModelTC/LightCompress
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
- Stars
- 751
- Forks
- 80
- Open issues
- 43
- Last push
- 5mo ago
About LightCompress
LightCompress is a free, open-source LLM chat app by ModelTC, written mainly in Python. [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models. It has 751 GitHub stars and 80 forks, and was last updated 5mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 751
- Last update
- 5mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
rtk84k stars · CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
repomix29k stars · 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
FinGPT21k stars · FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
LightCompress FAQ
Is LightCompress free?
Yes. LightCompress is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does LightCompress run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does LightCompress need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is LightCompress still maintained?
It was last updated 5mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to LightCompress?
Similar free, open-source tools include Hands-On-Large-Language-Models, rtk, Qwen, repomix.