sergqwer/strata-nvfp4
Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU expert
- Stars
- 192
- Forks
- 18
- Open issues
- 10
- Last push
- 1d ago
About strata-nvfp4
strata-nvfp4 is a free, open-source LLM chat app by sergqwer, written mainly in C++. Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU expert. It has 192 GitHub stars and 18 forks, and was last updated 1d ago. It's released under the MIT license, a standard open-source license. According to the project, it needs a GPU with at least 12 GB of memory.
- License
- MIT
- Commercial use
- Commercial OK
- Language
- C++
- Stars
- 192
- Last update
- 1d ago
- Runs on Mac
- Not stated
- GPU
- 12 GB+ (as stated by the project)
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程
project-maya1.9k stars · Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenA
llm_interview_note15k stars · 主要记录大语言大模型(LLMs) 算法(应用)工程师相关的知识及面试题
web-llm19k stars · Runs language models in web browsers for AI chatbots and assistants.
chinese-llm-benchmark6.5k stars · 非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.
ollama185k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
strata-nvfp4 FAQ
Can I use strata-nvfp4 commercially?
Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is strata-nvfp4 free?
Yes. strata-nvfp4 is open source and free to use. It's released under the MIT license, a standard open-source license.
Does strata-nvfp4 run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does strata-nvfp4 need a GPU?
According to the project, strata-nvfp4 needs a GPU with at least 12 GB of memory.
Is strata-nvfp4 still maintained?
Yes. It was last updated 1d ago and has 10 open issues on GitHub.
What are alternatives to strata-nvfp4?
Similar free, open-source tools include self-llm, project-maya, llm_interview_note, web-llm.