HowieHwong/TrustLLM
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestrat
- Stars
- 632
- Forks
- 69
- Open issues
- 7
- Last push
- 17d ago
About TrustLLM
TrustLLM is a free, open-source AI developer tool by HowieHwong, written mainly in Python. [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestrat. It has 632 GitHub stars and 69 forks, and was last updated 17d ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Python
- Stars
- 632
- Last update
- 17d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Yes
Similar free tools
langchain148k stars · The agent engineering platform.
litellm62k stars · The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
spaCy34k stars · 💫 Industrial-strength Natural Language Processing (NLP) in Python
dsh-our-free-model35k stars · 在 dsh 里装上这个插件即可，无需登录、注册或填 API Key，就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费，不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there,
deepeval19k stars · The LLM Evaluation Framework
TrustLLM FAQ
Is TrustLLM free?
TrustLLM is open source, but it needs a paid third-party API key to work. It's released under the MIT license, a standard open-source license.
Does TrustLLM run on a Mac?
Yes. According to the project, TrustLLM works on macOS.
Does TrustLLM need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is TrustLLM still maintained?
Yes. It was last updated 17d ago and has 7 open issues on GitHub.
What are alternatives to TrustLLM?
Similar free, open-source tools include langchain, litellm, RagaAI-Catalyst, spaCy.