LLM Provider SDKs LLM Tools

Python SDKs and unified interfaces for interacting with multiple LLM providers and AI services. Includes official provider SDKs, multi-provider wrappers, and gateway libraries. Does NOT include framework-specific integrations (like LangChain), application-level tools, or non-SDK libraries.

There are 110 llm provider sdks tools tracked. 9 score above 50 (established tier). The highest-rated is OpenCSGs/csghub-server at 69/100 with 1,414 stars. 2 of the top 10 are actively maintained.

Get all 110 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-provider-sdks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	OpenCSGs/csghub-server csghub-server is the backend server for CSGHub which helps user to manage...	69	Established	1,414	Go
2	OpenCSGs/csghub CSGHub is a brand-new open-source platform for managing LLMs, developed by...	67	Established	5,495	Vue
3	Haidra-Org/horde-sdk A python library to interact with AI-Horde's free generative AI APIs	64	Established	37	Python
4	Oaklight/ToolRegistry ToolRegistry: A Protocol-Agnostic Tool Management Library for Function-Calling LLMs	60	Established	48	Python
5	Lightning-AI/litAI LLM router + minimal agent framework in one. Call any LLM API with OpenAI...	59	Established	47	Python
6	lzjever/lexilux Unified LLM API client library for Python. Simple API for Chat, Embedding,...	58	Established	35	Python
7	Whth/fabricatio Fabricatio is a Python library designed for building applications that...	58	Established	7	Python
8	oop7/OrChat A powerful, feature-rich command-line interface for interacting with AI...	51	Established	78	Python
9	sunholo-data/sunholo-py A python library to enable GenAI and LLMOps within Google Cloud Platform	50	Established	17	Python
10	lmstudio-ai/lmstudio-python LM Studio Python SDK	49	Emerging	762	Python
11	OpenRouterTeam/openrouter-examples Examples of integrating the OpenRouter API	49	Emerging	303	TypeScript
12	reVrost/go-openrouter Unofficial API SDK for openrouter.ai in go	48	Emerging	107	Go
13	just-llms/justllms Production-ready Python library for multi-provider LLM orchestration	46	Emerging	40	Python
14	AI21Labs/ai21-python AI21 Python SDK	45	Emerging	70	Python
15	posit-dev/btw A complete toolkit for connecting R and LLMs	42	Emerging	113	R
16	MoonshotAI/kosong The LLM abstraction layer for modern AI agent applications.	41	Emerging	509	—
17	Aleph-Alpha/intelligence-layer-sdk a unified framework for leveraging LLMs	41	Emerging	73	Python
18	NiJingzhe/SimpleLLMFunc A simple and well-tailored LLM application framework that enables you to...	39	Emerging	76	Python
19	gumblex/aitoolman Controllable and Transparent LLM Application Framework	39	Emerging	4	Python
20	Lifailon/openrouter-bot This project allows to launch your Telegram bot in a few minutes to...	39	Emerging	83	Go
21	vishwa-labs/vishwa-ml-sdk Python SDK for vishwa.ai	39	Emerging	21	Python
22	anthalehq/anthale-python Anthale's official Python SDK	39	Emerging	1	Python
23	OoriData/Toolio GenAI & agent toolkit for Apple Silicon Mac, implementing JSON...	38	Emerging	132	Python
24	smartloop-ai/smartloop An agent to extract information and auto-tune from documents	37	Emerging	3	Shell
25	routeplex/routeplex-node Official Node.js SDK for RoutePlex — multi-model AI gateway	37	Emerging	1	JavaScript
26	uaiso-serious/infra uaiso serious ai lab	36	Emerging	6	Shell
27	speedshop/openrouter-us-only-cached-guardrail GitHub Action that updates an OpenRouter guardrail daily with US-only...	36	Emerging	21	Shell
28	modelmetry/modelmetry-sdk-python The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s...	36	Emerging	1	Python
29	Bioto/glue-llm A high-level Python SDK for Large Language Models with automatic tool...	36	Emerging	1	Python
30	openlit/helm Helm Charts to deploy and manage OpenLIT in Kubernetes	36	Emerging	9	Smarty
31	zetane/zetaforgedev Open source AI platform for rapid development of advanced AI and AGI pipelines.	36	Emerging	219	Python
32	lhenault/simpleAI An easy way to host your own AI API and expose alternative models, while...	35	Emerging	331	Python
33	AltairaLabs/Omnia Kubernetes operator for deploying and managing AI agents with WebSocket/gRPC...	35	Emerging	1	Go
34	seanbrar/pollux Multimodal orchestration for LLM APIs. Source patterns, context caching, and...	35	Emerging	1	Python
35	11divyansh/OxyJen OxyJen is an open-source Java framework for orchestrating LLM workloads with...	35	Emerging	24	Java
36	Tetramatrix/lemonade-python-sdk A production-grade Python SDK for the Lemonade LLM backend. Featuring...	34	Emerging	4	Python
37	Anilturaga/aiide Pragmatic framework to build LLM Copilots	34	Emerging	64	Python
38	llm-use/llm-use LLM orchestration toolkit for agent workflows: planner + workers +...	34	Emerging	34	Python
39	unit-mesh/choco-builder ChocoBuilder (Chocolate Factory) is a cutting-edge LLM toolkit designed to...	33	Emerging	223	Kotlin
40	dropbox/aana_sdk Aana SDK is a powerful framework for building AI enabled multimodal applications.	33	Emerging	58	Python
41	uripeled2/llm-client-sdk SDK for using LLM	32	Emerging	83	Python
42	wojtess/openrouter-api-go openrouter api integration in golang	32	Emerging	4	Go
43	nikhil-robinson/openrouter_client A comprehensive OpenRouter API client library for ESP32 (ESP-IDF), enabling...	32	Emerging	29	C
44	xemantic/xemantic-ai-tool-schema AI/LLM tool use (function calling) JSON Schema generator - a Kotlin...	32	Emerging	50	Kotlin
45	BraveGroup/SheetCopilot We release a general framework for prompting LLMs to manipulate software in...	31	Emerging	163	Python
46	litechain-ai/litechain The zero-boilerplate LLM framework for humans.	31	Emerging	9	TypeScript
47	eduardolat/openroutergo Easy to use OpenRouter Golang SDK	29	Experimental	49	Go
48	casibase/go-openrouter OpenRouter Go SDK	29	Experimental	10	Go
49	mmeerrkkaa/openrouter-kit Powerful & flexible TypeScript SDK for the OpenRouter API. Streamlines...	29	Experimental	39	TypeScript
50	SynergOps/openrouter.ai Simple terminal app to use Openrouter.ai with your personal API keys	29	Experimental	9	Shell
51	Cycls/cycls The open-source SDK for distributing AI agents.	28	Experimental	22	Python
52	nex-agi/weaver Python SDK for Weaver.	27	Experimental	13	Python
53	slava-vishnyakov/chatlet Python wrapper for the OpenRouter API	27	Experimental	6	Python
54	arkonis-dev/ark Kubernetes operator for running AI agents as first-class resources	26	Experimental	5	Go
55	dingo-actual/openrouter-python-client An unofficial Python client for OpenRouter	26	Experimental	4	Python
56	jvrck/openrouterlist OpenRouter model information	26	Experimental	7	HTML
57	lollipopkit/or-models-compare A static web page showcasing OpenRouter models, automatically updated daily,...	26	Experimental	6	HTML
58	JonahWhaler/llm-agent-toolkit LLM AgeToolkit provides minimal, modular interfaces for core components in...	25	Experimental	3	Python
59	instill-ai/helm-charts ⎈ The Helm charts of Instill AI	25	Experimental	2	—
60	tracehubpm/jivan Experimental neural static analyzer for Java programs, based on ML and LLM	24	Experimental	2	—
61	JavaAIDev/llm-agent-builder LLM Agent Builder	24	Experimental	2	Kotlin
62	Mattbusel/llm-agent Zero-dependency single-header C++ tool-calling agent loop. Define tools as...	24	Experimental	2	C++
63	hanzoai/python-sdk Hanzo Python SDK — LLM gateway, agents, and AI cloud	24	Experimental	2	Python
64	johnbrodowski/AgnosticToolBuilder A provider-agnostic tool builder for AI/LLM function calling that lets you...	23	Experimental	1	C#
65	lofye/foundry-framework Foundry is a modern LLM-First Web Framework written in PHP 8.4. It was...	23	Experimental	1	PHP
66	agentvoiceresponse/avr-llm-openrouter This repository showcases the integration between Agent Voice Response and...	23	Experimental	—	JavaScript
67	php-llm/fabric-pattern Slim PHP wrapper for Daniel Miessler's fabric pattern	23	Experimental	1	PHP
68	GodChatCapital/zeus-library Zeus - a revolutionary solution for storing, managing, and securing your...	22	Experimental	2	JavaScript
69	bsdfbsdfgsfbs/oprouter 🤖 Build AI-powered apps easily with OpRouter, a simple Python library for...	22	Experimental	—	Python
70	hltcoe/sandle Run a large language modeling SANDbox in your Local Environment	22	Experimental	7	Python
71	gsavla6-hue/java-llm-agent Autonomous LLM agent implementation in Java with tool use, planning and...	22	Experimental	—	Java
72	PrajwalAmte/AI-Engineering-Patterns Named patterns with trade-offs, implementation guides, and code examples for...	22	Experimental	—	MDX
73	Veerxps/1c-llm-requests 🚀 Streamline LLM integration with 1C databases using this simple HTTP...	22	Experimental	—	1C Enterprise
74	antoinezambelli/forge A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows	22	Experimental	—	Python
75	abelardodiaz/multi-ai-provider-patterns Production patterns for multi-AI provider gateways. 6 patterns with ASCII...	22	Experimental	—	Python
76	OptixSec/fabric_patterns A collection of patterns for use with the Fabric AI framework.	21	Experimental	8	Shell
77	hra42/openrouter-go A zero-dependency Go client library for the OpenRouter API with full...	21	Experimental	2	Go
78	Framstag/LLMAnalysisJinni A tool to implement complex analysis tasks using an LLM in cases where you...	21	Experimental	2	Java
79	jonschlinkert/model-exchange-grammar-protocol The Model Context Grammar Protocol defines a simple, extensible, and...	21	Experimental	7	—
80	DedInc/oprouter4j A Java client for the OpenRouter API. This library handles the HTTP layer,...	20	Experimental	1	Java
81	JavaAIDev/llm-agent-spec LLM Agent Spec	19	Experimental	—	Java
82	yamtimor/BirdLane Kotlin DSL for expressive, code-first data pipelines, inspired by jazz.	19	Experimental	8	Kotlin
83	DedInc/oprouter OpRouter is an asynchronous Python client for the OpenRouter API. It handles...	19	Experimental	—	Python
84	bluefermion/n8n-nodes-demeterics n8n community node for Demeterics LLM Gateway - access OpenAI, Anthropic,...	19	Experimental	—	TypeScript
85	AndrewBz512/llm-configs Production-ready LLM configuration templates for SecOps automation,...	19	Experimental	—	—
86	eykrehbein/foundry A framework-agnostic toolset to create and use Functions in LLM-based apps.	19	Experimental	23	TypeScript
87	TimHanewich/TimHanewich.Foundry A lightweight .NET library for interfacing with LLM deployments in Microsoft...	19	Experimental	—	C#
88	akka-samples/real-estate-cs-agent Responds to emails with LLM use and tools integration	18	Experimental	5	Java
89	janvanwassenhove/scrum Scrum programming language	17	Experimental	2	Java
90	LuchoBazz/PyLLM-Facade A modular Python library providing a unified interface for multiple LLM...	16	Experimental	1	Python
91	senxd/LLM-Interface A Kotlin Library for interfacing with LLMs.	16	Experimental	4	Kotlin
92	skobkin/openrouter-costs-tray See OpenRouter cost stats in your tray.	15	Experimental	—	Go
93	lastime1650/EDR_backend LLM AI EDR 백엔드	15	Experimental	—	YARA
94	jonaylor89/SaintJohn Minimal Android Launcher with built in LLM	15	Experimental	1	Kotlin
95	SwastikAI/swastikai-python-sdk Official Python SDK for SwastikAI	14	Experimental	11	Python
96	Qually5/ai-model-registry A centralized registry for managing and versioning AI models.	14	Experimental	—	Java
97	AndrewC0926/lattice-ops AI-powered operational intelligence platform for defense-scale facilities...	14	Experimental	—	TypeScript
98	VedanthB/ort OpenRouter Tool — access 344+ AI models from the terminal. One CLI for...	14	Experimental	—	Go
99	akka-samples/trip-agent LLM (Anthropic) with tools integration to find flights	14	Experimental	—	Java
100	iatsiuk/orx-cli CLI tool for sending prompts to multiple LLM models via OpenRouter API in parallel	14	Experimental	—	Go
101	d3287t328/DevOps-AI DevOps-AI	14	Experimental	7	Shell
102	EmreMutlu99/Ollama-Agent-Kit Llama Agent Kit is an open-source Node.js toolkit for building...	12	Experimental	11	JavaScript
103	liyedanpdx/llm-python-patterns Classic design patterns for LLM applications in Python. Interactive...	12	Experimental	1	Jupyter Notebook
104	MasterKun94/rpc-llm-bridge-java A Java framework that converts RPC services into tools for LLMs, enabling...	11	Experimental	—	Java
105	bkovacki/gopenrouter The GOpenRouter library provides convenient access to the OpenRouter REST...	11	Experimental	—	Go
106	mantissa-lab/PyGitForge A universal, AI-friendly Python client for Git forges (GitHub, GitLab,...	11	Experimental	—	Python
107	LLMPages/onesdk OneSDK is a Python library that provides a unified interface for interacting...	11	Experimental	2	Python
108	ioniccommerce/ionic_sdk_python Ionic Commerce Python SDK	10	Experimental	1	Python
109	BodhiHu/kubeflow-lab Kubeflow lab for running cloudy AI ops /w ease.	10	Experimental	1	Jupyter Notebook
110	JavaAIDev/common-llm-tools LLM Agent Builder Tools	10	Experimental	1	Java

Comparisons in this category

csghub-server and csghub (69 vs 67)