Mobile-Artificial-Intelligence/llama_sdk
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
- Stars
- 122
- Forks
- 25
- Open issues
- 8
- Last push
- 1d ago
llama_sdk star history
+1 this week
About llama_sdk
llama_sdk is a free, open-source AI inference tool by Mobile-Artificial-Intelligence, written mainly in C++. lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid). It has 122 GitHub stars and 25 forks, and was last updated 1d ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Commercial use
- Commercial OK
- Language
- C++
- Stars
- 122
- Last update
- 1d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
llama.cpp132k stars · LLM inference in C/C++
llm-action25k stars · 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
ai-infra-book7.0k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
PowerInfer9.8k stars · High-speed Large Language Model Serving for Local Deployment
cactus6.2k stars · Edge AI inference engine for mobile devices and wearables.
llamafile26k stars · Run LLMs and speech-to-text models with a single-file executable.
llama_sdk FAQ
Can I use llama_sdk commercially?
Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is llama_sdk free?
Yes. llama_sdk is open source and free to use. It's released under the MIT license, a standard open-source license.
Does llama_sdk run on a Mac?
Yes. According to the project, llama_sdk works on macOS.
Does llama_sdk need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llama_sdk still maintained?
Yes. It was last updated 1d ago and has 8 open issues on GitHub.
What are alternatives to llama_sdk?
Similar free, open-source tools include llama.cpp, llm-action, ai-infra-book, PowerInfer.
Maintain llama_sdk?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/Mobile-Artificial-Intelligence/llama_sdk)