tairov/llama2.mojo
Inference Llama 2 in one file of pure 🔥
- Stars
- 2.1k
- Forks
- 139
- Open issues
- 0
- Last push
- 22d ago
About llama2.mojo
llama2.mojo is a free, open-source AI inference tool by tairov, written mainly in Mojo. Inference Llama 2 in one file of pure 🔥. It has 2.1k GitHub stars and 139 forks, and was last updated 22d ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Mojo
- Stars
- 2,129
- Last update
- 22d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
llama-cookbook19k stars · Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model f
DeepSpeed43k stars · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
vllm95k stars · A high-throughput and memory-efficient inference and serving engine for LLMs
ColossalAI41k stars · Making large AI models cheaper, faster and more accessible
llama.cpp132k stars · LLM inference in C/C++
distributed-llama3.1k stars · Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
llama2.mojo FAQ
Is llama2.mojo free?
Yes. llama2.mojo is open source and free to use. It's released under the MIT license, a standard open-source license.
Does llama2.mojo run on a Mac?
Yes. According to the project, llama2.mojo works on macOS.
Does llama2.mojo need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llama2.mojo still maintained?
Yes. It was last updated 22d ago and has 0 open issues on GitHub.
What are alternatives to llama2.mojo?
Similar free, open-source tools include llama-cookbook, DeepSpeed, vllm, ColossalAI.