PKU-Alignment/safe-rlhf
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
- Stars
- 1.6k
- Forks
- 134
- Open issues
- 17
- Last push
- 11mo ago
About safe-rlhf
safe-rlhf is a free, open-source machine learning tool by PKU-Alignment, written mainly in Python. Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback. It has 1.6k GitHub stars and 134 forks, and was last updated 11mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 1,620
- Last update
- 11mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
LlamaFactory76k stars · Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
pytorch-image-models37k stars · The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT)
ludwig12k stars · Low-code framework for building custom LLMs, neural networks, and other AI models
argilla5.2k stars · Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
align-anything4.7k stars · Align Anything: Training All-modality Model with Feedback
easy-dataset15k stars · A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
safe-rlhf FAQ
Is safe-rlhf free?
Yes. safe-rlhf is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does safe-rlhf run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does safe-rlhf need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is safe-rlhf still maintained?
It was last updated 11mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to safe-rlhf?
Similar free, open-source tools include LlamaFactory, pytorch-image-models, ludwig, argilla.