sophgo/LLM-TPU
Run generative AI models in sophgo BM1684X/BM1688
- Stars
- 318
- Forks
- 55
- Open issues
- 12
- Last push
- 10d ago
About LLM-TPU
LLM-TPU is a free, open-source LLM chat app by sophgo, written mainly in C++. Run generative AI models in sophgo BM1684X/BM1688. It has 318 GitHub stars and 55 forks, and was last updated 10d ago. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to the project, it works on macOS.
- License
- Not detected
- Language
- C++
- Stars
- 318
- Last update
- 10d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
ai27k stars · The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
repomix29k stars · 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
LLM-TPU FAQ
Is LLM-TPU free?
Yes. LLM-TPU is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does LLM-TPU run on a Mac?
Yes. According to the project, LLM-TPU works on macOS.
Does LLM-TPU need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is LLM-TPU still maintained?
Yes. It was last updated 10d ago and has 12 open issues on GitHub.
What are alternatives to LLM-TPU?
Similar free, open-source tools include Hands-On-Large-Language-Models, ai, repomix, Qwen.