cactus-compute/needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
- Stars
- 14k
- Forks
- 980
- Open issues
- 3
- Last push
- 3d ago
About needle
needle is a free, open-source RAG and AI search tool by cactus-compute, written mainly in Python. Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers. It has 14k GitHub stars and 980 forks, and was last updated 3d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 14,194
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
onyx33k stars · Open Source AI Platform - AI Chat with advanced features that works with every LLM
private-gpt58k stars · Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
Vane38k stars · Vane is an AI-powered answering engine.
yu-ai-agent2.7k stars · 编程导航 AI 开发实战新项目，基于 Spring Boot 3 + Java 21 + Spring AI 构建 AI 恋爱大师应用和 ReAct 模式自主规划智能体YuManus，覆盖 AI 大模型接入、Spring AI 核心特性、Prompt 工程和优化、RAG 检索增强、向量数据库、Tool Calling 工具调用、MCP 模型上下文协议、AI Agent 开发（Manas Java
semantica14k stars · Graph-Native Infrastructure for Context and Accountable AI Systems
ragflow93k stars · RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
needle FAQ
Is needle free?
Yes. needle is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does needle run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does needle need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is needle still maintained?
Yes. It was last updated 3d ago and has 3 open issues on GitHub.
What are alternatives to needle?
Similar free, open-source tools include onyx, private-gpt, Vane, yu-ai-agent.