NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
- Stars
- 18k
- Forks
- 4.7k
- Open issues
- 469
- Last push
- today
About Megatron-LM
Megatron-LM is a free, open-source LLM chat app by NVIDIA, written mainly in Python. Ongoing research training transformer models at scale. It has 18k GitHub stars and 4.7k forks, and was last updated today. GitHub doesn't detect a standard license, so check the repository before using it commercially.
- License
- Not detected
- Language
- Python
- Stars
- 18,239
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
FinGPT21k stars · FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
FastChat40k stars · An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
RWKV-LM15k stars · RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
Megatron-LM FAQ
Is Megatron-LM free?
Yes. Megatron-LM is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does Megatron-LM run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does Megatron-LM need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Megatron-LM still maintained?
Yes. It was last updated today and has 469 open issues on GitHub.
What are alternatives to Megatron-LM?
Similar free, open-source tools include Hands-On-Large-Language-Models, Qwen, FinGPT, FastChat.