toby-bridges/api-relay-audit
Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks.
- Stars
- 887
- Forks
- 84
- Open issues
- 12
- Last push
- today
About api-relay-audit
api-relay-audit is a free, open-source AI developer tool by toby-bridges, written mainly in Python. Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks. It has 887 GitHub stars and 84 forks, and was last updated today. It's released under the AGPL-3.0 license, a standard open-source license.
- License
- AGPL-3.0
- Language
- Python
- Stars
- 887
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Not stated
Similar free tools
litellm62k stars · The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
langchain148k stars · The agent engineering platform.
dsh-our-free-model35k stars · 在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there,
prompt-optimizer39k stars · An AI prompt optimizer for writing better prompts and getting better AI results.
new-api50k stars · A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for pers
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
api-relay-audit FAQ
Is api-relay-audit free?
api-relay-audit is open source, but it needs a paid third-party API key to work. It's released under the AGPL-3.0 license, a standard open-source license.
Does api-relay-audit run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does api-relay-audit need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is api-relay-audit still maintained?
Yes. It was last updated today and has 12 open issues on GitHub.
What are alternatives to api-relay-audit?
Similar free, open-source tools include litellm, langchain, dsh-our-free-model, prompt-optimizer.