rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- Stars
- 107k
- Forks
- 16k
- Open issues
- 2
- Last push
- 20d ago
About LLMs-from-scratch
LLMs-from-scratch is a free, open-source LLM chat app by rasbt, written mainly in Jupyter Notebook. Implement a ChatGPT-like LLM in PyTorch from scratch, step by step. It has 107k GitHub stars and 16k forks, and was last updated 20d ago. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to its README, it works on macOS.
- License
- Not detected
- Language
- Jupyter Notebook
- Stars
- 107,081
- Last update
- 20d ago
- Runs on Mac
- Yes (per README)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
ai27k stars · The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
RWKV-LM15k stars · RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a
repomix29k stars · 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like
LLMs-from-scratch FAQ
Is LLMs-from-scratch free?
Yes. LLMs-from-scratch is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does LLMs-from-scratch run on a Mac?
Yes. According to its README, LLMs-from-scratch works on macOS.
Does LLMs-from-scratch need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is LLMs-from-scratch still maintained?
Yes. It was last updated 20d ago and has 2 open issues on GitHub.
What are alternatives to LLMs-from-scratch?
Similar free, open-source tools include Hands-On-Large-Language-Models, gpt_academic, Qwen, ai.