scaleapi/llm-engine
Scale LLM Engine public repository
- Stars
- 839
- Forks
- 83
- Open issues
- 13
- Last push
- today
About llm-engine
llm-engine is a free, open-source LLM chat app by scaleapi, written mainly in Python. Scale LLM Engine public repository. It has 839 GitHub stars and 83 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 839
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Yes
Similar free tools
llm-workflow-engine3.7k stars · Power CLI and Workflow manager for LLMs (core package)
Soup9.5k stars · Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
h2o-llmstudio5.2k stars · H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
llm-engine FAQ
Is llm-engine free?
llm-engine is open source, but it needs a paid third-party API key to work. It's released under the Apache-2.0 license, a standard open-source license.
Does llm-engine run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does llm-engine need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llm-engine still maintained?
Yes. It was last updated today and has 13 open issues on GitHub.
What are alternatives to llm-engine?
Similar free, open-source tools include llm-workflow-engine, Soup, h2o-llmstudio, self-llm.