StarlightSearch/EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
- Stars
- 1.3k
- Forks
- 139
- Open issues
- 20
- Last push
- 27d ago
About EmbedAnything
EmbedAnything is a free, open-source AI inference tool by StarlightSearch, written mainly in Rust. Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀. It has 1.3k GitHub stars and 139 forks, and was last updated 27d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Rust
- Stars
- 1,318
- Last update
- 27d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
ColossalAI41k stars · Making large AI models cheaper, faster and more accessible
ray44k stars · Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
DeepSpeed43k stars · DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
PowerInfer9.8k stars · High-speed Large Language Model Serving for Local Deployment
Made-With-ML50k stars · Learn how to develop, deploy and iterate on production-grade ML applications.
EmbedAnything FAQ
Is EmbedAnything free?
Yes. EmbedAnything is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does EmbedAnything run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does EmbedAnything need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is EmbedAnything still maintained?
Yes. It was last updated 27d ago and has 20 open issues on GitHub.
What are alternatives to EmbedAnything?
Similar free, open-source tools include ColossalAI, ray, BentoML, DeepSpeed.