mozilla-ai/any-llm
Communicate with an LLM provider using a single interface
Provides unified access to OpenAI, Anthropic, Mistral, Ollama, and other LLM providers through a single `completion()` function with modular provider installation. Built on official provider SDKs to ensure compatibility, with optional FastAPI gateway adding budget enforcement, usage analytics, and multi-tenant support for production deployments. Supports both direct library usage for experimentation and class-based interfaces for managing persistent provider connections.
1,750 stars. Actively maintained with 51 commits in the last 30 days.
Stars
1,750
Forks
152
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 12, 2026
Commits (30d)
51
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/mozilla-ai/any-llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
Maximilian-Winter/llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models...
CliDyn/climsight
A next-generation climate information system that uses large language models (LLMs) alongside...
ShishirPatil/gorilla
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
rizerphe/local-llm-function-calling
A tool for generating function arguments and choosing what function to call with local LLMs
OoriData/OgbujiPT
Client-side toolkit for using large language models, including where self-hosted