tdi/awesome-private-ai
Curated list of tools, frameworks, and resources for running, building, and deploying AI privately — on-prem, air-gapped, or self-hosted.
It details specific inference runtimes like `vLLM` for high-throughput LLMs and `whisper.cpp` for local speech recognition, alongside tools for model management like `Ray Serve` and `Seldon Core` on Kubernetes. The list also covers fine-tuning with `LoRA` and `PEFT`, vector databases like `Milvus` and `Qdrant`, and agent orchestration frameworks such as `LangChain` and `LlamaIndex`, many with native Ollama support.
156 stars. No commits in the last 6 months.
Stars
156
Forks
22
Language
—
License
CC0-1.0
Category
Last pushed
Sep 15, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/tdi/awesome-private-ai"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
steel-dev/awesome-web-agents
🔥 A list of tools, frameworks, and resources for building AI web agents
ashishpatel26/500-AI-Agents-Projects
The 500 AI Agents Projects is a curated collection of AI agent use cases across various...
Jenqyang/Awesome-AI-Agents
A collection of autonomous agents 🤖️ powered by LLM.
jim-schwoebel/awesome_ai_agents
🤖 A comprehensive list of 1,500+ resources and tools related to AI agents.
mahseema/awesome-ai-tools
A curated list of Artificial Intelligence Top Tools