FreeAIRepo
LLMs & chat

ROCm/FastFlowLM

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

CPU only OKC++
Open on GitHub Website
Stars
2.0k
Forks
170
Open issues
174
Last push
today

About FastFlowLM

FastFlowLM is a free, open-source LLM chat app by ROCm, written mainly in C++. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs. It has 2.0k GitHub stars and 170 forks, and was last updated today. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to the project, it runs on a regular CPU without a GPU.

License
Not detected
Language
C++
Stars
1,980
Last update
today
Runs on Mac
Not stated
GPU
Not needed (runs on CPU)
Paid API key
Not stated
Self-hostable
Not stated

Similar free tools

All LLMs & chat tools →

FastFlowLM FAQ

Is FastFlowLM free?

Yes. FastFlowLM is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.

Does FastFlowLM run on a Mac?

The project doesn't say. Check its installation guide before you start.

Does FastFlowLM need a GPU?

No. According to the project, FastFlowLM runs on a regular CPU.

Is FastFlowLM still maintained?

Yes. It was last updated today and has 174 open issues on GitHub.

What are alternatives to FastFlowLM?

Similar free, open-source tools include ollama, Chinese-LLaMA-Alpaca, unsloth, Chinese-LLaMA-Alpaca-2.

Related topics

amddeepseekllamallmnpufastflowlm