huawei-csl/SINQ
Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model smaller while preserving accuracy [ICML 2026]
- Stars
- 635
- Forks
- 50
- Open issues
- 7
- Last push
- 5mo ago
About SINQ
SINQ is a free, open-source LLM chat app by huawei-csl, written mainly in Python. Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model smaller while preserving accuracy [ICML 2026]. It has 635 GitHub stars and 50 forks, and was last updated 5mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 635
- Last update
- 5mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
repomix29k stars · 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like
FinGPT21k stars · FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
ai27k stars · The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
ollama184k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
SINQ FAQ
Is SINQ free?
Yes. SINQ is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does SINQ run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does SINQ need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is SINQ still maintained?
It was last updated 5mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to SINQ?
Similar free, open-source tools include Hands-On-Large-Language-Models, Qwen, repomix, FinGPT.