skyzh/tiny-llm
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
- Stars
- 4.8k
- Forks
- 410
- Open issues
- 8
- Last push
- 1d ago
About tiny-llm
tiny-llm is a free, open-source AI resource list by skyzh, written mainly in Python. learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen. It has 4.8k GitHub stars and 410 forks, and was last updated 1d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- Python
- Stars
- 4,784
- Last update
- 1d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
KG-LLM-Papers2.2k stars · [Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
LLM-eval-survey1.6k stars · The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
Multimodal-AND-Large-Language-Models764 stars · Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.
KnowledgeEditingPapers1.3k stars · Must-read Papers on Knowledge Editing for Large Language Models.
LLM_MultiAgents_Survey_Papers1.3k stars · Large Language Model based Multi-Agents: A Survey of Progress and Challenges (In IJCAI 2024)
Vision-Language-Models-Overview731 stars · A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.
tiny-llm FAQ
Is tiny-llm free?
Yes. tiny-llm is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does tiny-llm run on a Mac?
Yes. According to the project, tiny-llm works on macOS.
Does tiny-llm need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is tiny-llm still maintained?
Yes. It was last updated 1d ago and has 8 open issues on GitHub.
What are alternatives to tiny-llm?
Similar free, open-source tools include KG-LLM-Papers, LLM-eval-survey, Multimodal-AND-Large-Language-Models, KnowledgeEditingPapers.