FreeAIRepo
Inference & serving

heterodoxin/AbliteratedOutTheBox

llama.cpp fork that abliterates at inference

Really freeCommercial OK · MITCPU only OKC++
Open on GitHub
Stars
128
Forks
14
Open issues
0
Last push
2d ago

About AbliteratedOutTheBox

AbliteratedOutTheBox is a free, open-source AI inference tool by heterodoxin, written mainly in C++. llama.cpp fork that abliterates at inference. It has 128 GitHub stars and 14 forks, and was last updated 2d ago. It's released under the MIT license, a standard open-source license. According to the project, it runs on a regular CPU without a GPU.

License
MIT
Commercial use
Commercial OK
Language
C++
Stars
128
Last update
2d ago
Runs on Mac
Not stated
GPU
Not needed (runs on CPU)
Paid API key
Not required
Self-hostable
Not stated

Similar free tools

All Inference & serving tools →

AbliteratedOutTheBox FAQ

Can I use AbliteratedOutTheBox commercially?

Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.

Is AbliteratedOutTheBox free?

Yes. AbliteratedOutTheBox is open source and free to use. It's released under the MIT license, a standard open-source license.

Does AbliteratedOutTheBox run on a Mac?

The project doesn't say. Check its installation guide before you start.

Does AbliteratedOutTheBox need a GPU?

No. According to the project, AbliteratedOutTheBox runs on a regular CPU.

Is AbliteratedOutTheBox still maintained?

Yes. It was last updated 2d ago and has 0 open issues on GitHub.

What are alternatives to AbliteratedOutTheBox?

Similar free, open-source tools include llama.cpp, llm-action, ai-infra-book, mlc-llm.

Related topics

abliterationaiinferencellama-cppllmllmsllama.cppabliteratedoutthebox