jmerelnyc/Talos
GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.
- Stars
- 673
- Forks
- 19
- Open issues
- 0
- Last push
- 3mo ago
About Talos
Talos is a free, open-source AI inference tool by jmerelnyc, written mainly in Python. GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts. It has 673 GitHub stars and 19 forks, and was last updated 3mo ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Python
- Stars
- 673
- Last update
- 3mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
llm-action25k stars · 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
ray44k stars · Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
skypilot11k stars · The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
distributed-llama3.1k stars · Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Talos FAQ
Is Talos free?
Yes. Talos is open source and free to use. It's released under the MIT license, a standard open-source license.
Does Talos run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Talos need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Talos still maintained?
It was last updated 3mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to Talos?
Similar free, open-source tools include ai-infra-book, llm-action, TensorRT-LLM, ray.