theodo-group/GenossGPT
One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.
Provides a Uvicorn-based REST API with OpenAI-compatible endpoints for chat completion and embeddings, enabling drop-in replacement without client code changes. Currently supports GPT4ALL with local model execution; planned expansions include HuggingFace inference API wrapping, cloud provider integrations (GCP/AWS/Azure), and user management via API keys.
753 stars. No commits in the last 6 months.
Stars
753
Forks
63
Language
Python
License
—
Category
Last pushed
Dec 15, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/theodo-group/GenossGPT"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
vtuber-plan/langport
Langport is a language model inference service
ariannamethod/molequla
molequla.ai. live ecology of GPT organisms
ictnlp/Stream-Omni
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports...
josStorer/selfhostedAI
A collection of one-click self-hosted AI