michaelfeil/infinity
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- Stars
- 3.0k
- Forks
- 216
- Open issues
- 111
- Last push
- today
About infinity
infinity is a free, open-source RAG and AI search tool by michaelfeil, written mainly in Rust. Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali. It has 3.0k GitHub stars and 216 forks, and was last updated today. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Rust
- Stars
- 2,967
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
milvus46k stars · Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
FlagEmbedding12k stars · Retrieval and Retrieval-augmented LLMs
infinity4.7k stars · The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
AnglE575 stars · Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
BERTopic7.9k stars · Leveraging BERT and c-TF-IDF to create easily interpretable topics.
WeKnora35k stars · Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
infinity FAQ
Is infinity free?
Yes. infinity is open source and free to use. It's released under the MIT license, a standard open-source license.
Does infinity run on a Mac?
Yes. According to the project, infinity works on macOS.
Does infinity need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is infinity still maintained?
Yes. It was last updated today and has 111 open issues on GitHub.
What are alternatives to infinity?
Similar free, open-source tools include milvus, FlagEmbedding, infinity, AnglE.