NimbleEdge/sparse_transformers
Sparse Inferencing for transformer based LLMs
- Stars
- 222
- Forks
- 12
- Open issues
- 9
- Last push
- 7mo ago
About sparse_transformers
sparse_transformers is a free, open-source LLM chat app by NimbleEdge, written mainly in Python. Sparse Inferencing for transformer based LLMs. It has 222 GitHub stars and 12 forks, and was last updated 7mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 222
- Last update
- 7mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
transformer-explainer9.0k stars · Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
chronos-forecasting6.2k stars · Chronos: Pretrained Models for Time Series Forecasting
litgpt14k stars · 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
RWKV-LM15k stars · RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a
Megatron-LM18k stars · Ongoing research training transformer models at scale
sparse_transformers FAQ
Is sparse_transformers free?
Yes. sparse_transformers is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does sparse_transformers run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does sparse_transformers need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is sparse_transformers still maintained?
It was last updated 7mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to sparse_transformers?
Similar free, open-source tools include Hands-On-Large-Language-Models, transformer-explainer, chronos-forecasting, litgpt.