coaidev/coai
🚀 Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
Implements a decoupled microservices architecture with a separate blob service for file parsing (supporting S3/R2/MinIO backends and OCR), integrates SearXNG for multi-engine web search, and provides OpenAI API-compatible endpoints enabling proxying of 200+ models through a single deployment. Built with Next.js frontend (Shadcn UI + Tremor) and supports PWA/Tauri desktop clients, with zero-cost cross-device sync via database-backed conversation persistence rather than external storage solutions.
9,008 stars. Actively maintained with 1 commit in the last 30 days.
Stars
9,008
Forks
1,188
Language
TypeScript
License
Apache-2.0
Category
Last pushed
Mar 12, 2026
Commits (30d)
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/coaidev/coai"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway