FreeAIRepo
LLMs & chat

ling0322/libllm

A lightweight vLLM-style inference engine in Rust

Really freeCommercial OK · MITRuns on MacC++
Open on GitHub
Stars
154
Forks
7
Open issues
1
Last push
1mo ago

libllm star history

+0 this week

154 ★
21 Oct25 Oct
libllm went from 154 to 154 GitHub stars over the last 4 days.

About libllm

libllm is a free, open-source LLM chat app by ling0322, written mainly in C++. A lightweight vLLM-style inference engine in Rust. It has 154 GitHub stars and 7 forks, and was last updated 1mo ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.

License
MIT
Commercial use
Commercial OK
Language
C++
Stars
154
Last update
1mo ago
Runs on Mac
Yes (as stated by the project)
GPU
Not stated
Paid API key
Not required
Self-hostable
Not stated

Similar free tools

All LLMs & chat tools →

libllm FAQ

Can I use libllm commercially?

Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.

Is libllm free?

Yes. libllm is open source and free to use. It's released under the MIT license, a standard open-source license.

Does libllm run on a Mac?

Yes. According to the project, libllm works on macOS.

Does libllm need a GPU?

The project doesn't state hardware needs. AI models generally run much faster with a GPU.

Is libllm still maintained?

It was last updated 1mo ago. Check recent issues on GitHub to judge how active it is.

What are alternatives to libllm?

Similar free, open-source tools include Hands-On-Large-Language-Models, open-webui, web-llm, mcp-for-blender.

Maintain libllm?

Add this badge to your README to show it's featured on FreeAIRepo.

Featured on FreeAIRepo
[![Featured on FreeAIRepo](https://www.freeairepo.com/badge/ling0322/libllm.svg)](https://www.freeairepo.com/repo/ling0322/libllm)

Related topics

aicpplanguage-modelpythonllamallmrustinference