lasgroup/SDPO
Reinforcement Learning via Self-Distillation (SDPO)
- Stars
- 1.1k
- Forks
- 130
- Open issues
- 9
- Last push
- 3mo ago
About SDPO
SDPO is a free, open-source machine learning tool by lasgroup, written mainly in Python. Reinforcement Learning via Self-Distillation (SDPO). It has 1.1k GitHub stars and 130 forks, and was last updated 3mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 1,130
- Last update
- 3mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
oat674 stars · 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
mini-verl307 stars · verl for a single consumer GPU. PPO, GRPO and on-policy distillation on NVIDIA GPUs.
Jackrong-llm-finetuning-guide1.7k stars · An educational, end-to-end open-source knowledge base for LLM fine-tuning, dataset distillation, reinforcement learning, and local deployment.
AI-Compass986 stars · “AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。
pmetal330 stars · PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
DiffusionOPSD879 stars · 🔥 On-Policy Self-Distillation in Diffusion Models
SDPO FAQ
Is SDPO free?
Yes. SDPO is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does SDPO run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does SDPO need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is SDPO still maintained?
It was last updated 3mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to SDPO?
Similar free, open-source tools include oat, mini-verl, Jackrong-llm-finetuning-guide, AI-Compass.