EricLBuehler/mistral.rs
Fast, flexible LLM inference
Really freeMITRuns on MacRust
- Stars
- 7.8k
- Forks
- 746
- Open issues
- 256
- Last push
- today
About mistral.rs
mistral.rs is a free, open-source LLM chat app by EricLBuehler, written mainly in Rust. Fast, flexible LLM inference. It has 7.8k GitHub stars and 746 forks, and was last updated today. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Rust
- Stars
- 7,762
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
rtk84k stars · CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
omlx23k stars · LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
llm_interview_note15k stars · 主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题
mistral.rs FAQ
Is mistral.rs free?
Yes. mistral.rs is open source and free to use. It's released under the MIT license, a standard open-source license.
Does mistral.rs run on a Mac?
Yes. According to the project, mistral.rs works on macOS.
Does mistral.rs need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is mistral.rs still maintained?
Yes. It was last updated today and has 256 open issues on GitHub.
What are alternatives to mistral.rs?
Similar free, open-source tools include self-llm, Open-LLM-VTuber, open-webui, rtk.