NVIDIA/GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
- Stars
- 4.2k
- Forks
- 1.1k
- Open issues
- 47
- Last push
- 1mo ago
About GenerativeAIExamples
GenerativeAIExamples is a free, open-source AI inference tool by NVIDIA, written mainly in Jupyter Notebook. Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture. It has 4.2k GitHub stars and 1.1k forks, and was last updated 1mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Jupyter Notebook
- Stars
- 4,213
- Last update
- 1mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
PowerInfer9.8k stars · High-speed Large Language Model Serving for Local Deployment
llmware15k stars · Unified framework for building enterprise RAG pipelines with small, specialized models
ColossalAI41k stars · Making large AI models cheaper, faster and more accessible
vllm95k stars · A high-throughput and memory-efficient inference and serving engine for LLMs
GenerativeAIExamples FAQ
Is GenerativeAIExamples free?
Yes. GenerativeAIExamples is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does GenerativeAIExamples run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does GenerativeAIExamples need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is GenerativeAIExamples still maintained?
It was last updated 1mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to GenerativeAIExamples?
Similar free, open-source tools include TensorRT-LLM, BentoML, PowerInfer, llmware.