adumrewal/llm-api-gateway
Gateway to control LLM API/SDK calls. Supports access to OpenAI, Azure, Anthropic and Bedrock calls
This tool helps developers streamline how their applications access various large language models (LLMs) from different providers like OpenAI, Azure, and AWS Bedrock. It takes your application's LLM prompts and routes them to your preferred model, returning the generated text or data. This is for software developers or architects building applications that rely on multiple LLM services.
No commits in the last 6 months.
Use this if you are building an application that needs to flexibly call different LLM APIs and want a single point of control for routing requests and managing configurations.
Not ideal if your application only uses one LLM provider or if you need advanced features like streaming, caching, or detailed logging built into the gateway.
Stars
4
Forks
—
Language
Python
License
—
Category
Last pushed
Oct 22, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/generative-ai/adumrewal/llm-api-gateway"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
openvinotoolkit/model_server
A scalable inference server for models optimized with OpenVINO™
madroidmaq/mlx-omni-server
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically...
NVIDIA-NeMo/Guardrails
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based...
rhesis-ai/rhesis
Open-source platform & SDK for testing LLM and agentic apps. Define expected behavior, generate...
generative-computing/mellea
Mellea is a library for writing generative programs.