FreeAIRepo
LLMs & chat

antirez/gguf-tools

GGUF implementation in C as a library and a tools CLI program

Really freeMITC
Stars
371
Forks
40
Open issues
7
Last push
5mo ago

About gguf-tools

gguf-tools is a free, open-source LLM chat app by antirez, written mainly in C. GGUF implementation in C as a library and a tools CLI program. It has 371 GitHub stars and 40 forks, and was last updated 5mo ago. It's released under the MIT license, a standard open-source license.

License
MIT
Language
C
Stars
371
Last update
5mo ago
Runs on Mac
Not stated
GPU
Not stated
Paid API key
Not required
Self-hostable
Not stated

Similar free tools

All LLMs & chat tools →

gguf-tools FAQ

Is gguf-tools free?

Yes. gguf-tools is open source and free to use. It's released under the MIT license, a standard open-source license.

Does gguf-tools run on a Mac?

The project doesn't say. Check its installation guide before you start.

Does gguf-tools need a GPU?

The project doesn't state hardware needs. AI models generally run much faster with a GPU.

Is gguf-tools still maintained?

It was last updated 5mo ago. Check recent issues on GitHub to judge how active it is.

What are alternatives to gguf-tools?

Similar free, open-source tools include rtk, khoj, open-webui, Open-LLM-VTuber.

Related topics