huggingface/nanotron
Minimalistic large language model 3D-parallelism training
- Stars
- 2.8k
- Forks
- 340
- Open issues
- 74
- Last push
- 14d ago
About nanotron
nanotron is a free, open-source machine learning tool by huggingface, written mainly in Python. Minimalistic large language model 3D-parallelism training. It has 2.8k GitHub stars and 340 forks, and was last updated 14d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 2,844
- Last update
- 14d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
pytorch-image-models37k stars · The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT)
align-anything4.7k stars · Align Anything: Training All-modality Model with Feedback
HRM-Text2.2k stars · HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.
CLUE4.3k stars · 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
DoRA1.0k stars · [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
nanotron FAQ
Is nanotron free?
Yes. nanotron is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does nanotron run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does nanotron need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is nanotron still maintained?
Yes. It was last updated 14d ago and has 74 open issues on GitHub.
What are alternatives to nanotron?
Similar free, open-source tools include pytorch-image-models, align-anything, HRM-Text, trl.