marcelroed/gigatoken
Language model tokenization at GB/s
- Stars
- 4.1k
- Forks
- 220
- Open issues
- 20
- Last push
- 1mo ago
About gigatoken
gigatoken is a free, open-source LLM chat app by marcelroed, written mainly in Rust. Language model tokenization at GB/s. It has 4.1k GitHub stars and 220 forks, and was last updated 1mo ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Rust
- Stars
- 4,133
- Last update
- 1mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
langextract39k stars · A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
FinGPT21k stars · FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
tokenizers11k stars · 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
gigatoken FAQ
Is gigatoken free?
Yes. gigatoken is open source and free to use. It's released under the MIT license, a standard open-source license.
Does gigatoken run on a Mac?
Yes. According to the project, gigatoken works on macOS.
Does gigatoken need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is gigatoken still maintained?
It was last updated 1mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to gigatoken?
Similar free, open-source tools include Hands-On-Large-Language-Models, Qwen, langextract, FinGPT.