xLLM-AI/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

Apache-2.0Runs on MacC++

Open on GitHub Website

Stars: 1.6k
Forks: 315
Open issues: 84
Last push: today

About xllm

xllm is a free, open-source LLM chat app by xLLM-AI, written mainly in C++. A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation. It has 1.6k GitHub stars and 315 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.

License: Apache-2.0
Language: C++
Stars: 1,603
Last update: today
Runs on Mac: Yes (as stated by the project)
GPU: Not stated
Paid API key: Not stated
Self-hostable: Yes