Local LLM Integration MCP Servers

Tools for integrating and running local LLMs (via Ollama, llama-cpp, etc.) as MCP servers or clients, enabling local inference and tool chaining. Does NOT include cloud-based LLM providers, LLM fine-tuning frameworks, or general LLM SDKs without MCP integration.

There are 66 local llm integration servers tracked. 4 score above 50 (established tier). The highest-rated is jonigl/mcp-client-for-ollama at 69/100 with 563 stars and 3,964 monthly downloads. 2 of the top 10 are actively maintained.

Get all 66 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mcp&subcategory=local-llm-integration&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Server	Score	Tier	Stars	Language
1	jonigl/mcp-client-for-ollama A text-based user interface (TUI) client for interacting with MCP servers...	69	Established	563	Python
2	ArcadeAI/arcade-mcp The best way to create, deploy, and share MCP Servers	57	Established	824	Python
3	hmldns/nautex MCP server for guiding Coding Agents via end-to-end requirements to...	54	Established	70	Python
4	possible055/relace-mcp Unofficial Relace MCP client with AI features. Personal project; not...	51	Established	27	Python
5	CogitatorTech/omni-nli A multi-interface (REST and MCP) server for natural language inference	48	Emerging	3	Python
6	Dicklesworthstone/ultimate_mcp_server Comprehensive MCP server exposing dozens of capabilities to AI agents:...	48	Emerging	143	Python
7	clanker-lover/spicebridge MCP server that gives AI assistants direct access to ngspice circuit...	47	Emerging	8	Python
8	habedi/omni-lpr A multi-interface (REST and MCP) server for automatic license plate recognition 🚗	46	Emerging	22	Python
9	SecretiveShell/MCP-Bridge A middleware to provide an openAI compatible endpoint that can call MCP tools	45	Emerging	920	Python
10	run-llama/mcp-server-llamacloud A MCP server connecting to managed indexes on LlamaCloud	39	Emerging	86	JavaScript
11	zinja-coder/zin-mcp-client MCP Client which serves as bridge between mcp servers and local LLMs running...	37	Emerging	99	Python
12	lmwilki/civ6-mcp An MCP server that lets LLM agents play Civilization VI.	36	Emerging	6	Python
13	Damien829/aipaygen Open-source MCP server with 250+ AI tools. Research, code, scrape,...	35	Emerging	1	Python
14	larsenweigle/langextract-mcp FastMCP for Google's langextract library	35	Emerging	28	Python
15	fungiboletus/mcp_cafe Professional and useful coffee breaks for AI agents	33	Emerging	6	Python
16	thpeng/lokis-mcp Lokis MCP Server will trick your LLM	33	Emerging	2	Java
17	arjunprabhulal/mcp-llama3-client A client for the MCP Flight Search service using Ollama and Llama 3.2 to...	32	Emerging	9	Python
18	AuraFriday/llm_mcp MCP server that runs local LLMs (with full access to MCP tools included)....	32	Emerging	1	Python
19	KishinInfoSec/ollama-agent-cli A powerful command-line tool for interacting with Ollama models as a...	31	Emerging	5	Python
20	mytechnotalent/Local_MCP_Client Local MCP Client is a cross-platform web and API interface for interacting...	31	Emerging	5	Python
21	castlebbs/gradio-mcp-hackathon Our participation to the 2025 Gradio Agent MCP Hackathon	31	Emerging	13	Python
22	OpenAdaptAI/OmniMCP OmniMCP uses Microsoft OmniParser and Model Context Protocol (MCP) to...	30	Emerging	71	Python
23	siliconsociety/FortunaMCP FortunaMCP is an advanced MCP server dedicated to generating high-quality...	29	Experimental	5	Python
24	flothjl/langtools-mcp Supercharge AI agents with programming language tools	28	Experimental	3	Python
25	angrysky56/ai_writers_workshop A Model Context Protocol server that provides narrative, character, and...	25	Experimental	2	Python
26	Octid-io/cloudless-sky OSMP — Octid Semantic Mesh Protocol. Agentic AI instruction encoding for any channel.	25	Experimental	3	Python
27	juliensimon/gradio-mcp-server-builder A CLI tool to create MCP (Model Context Protocol) servers with Gradio web...	25	Experimental	2	Python
28	kirillsaidov/ollama-mcp-example Ollama MCP example for dummies.	23	Experimental	10	Python
29	yanmxa/litemcp A minimal, lightweight client designed to simplify SDK adoption into MCP	22	Experimental	7	Python
30	BerriAI/litellm-agent-mcp MCP server giving AI agents access to 100+ LLMs through LiteLLM	22	Experimental	3	Python
31	jibbs1703/Retail-Chat-Agent-MCP This repository contains the scripts to build and deploy the Model Context...	22	Experimental	—	Python
32	RomiconEZ/llamator-mcp-server MCP server for llamator: automate LLM red teaming workflows	22	Experimental	4	Python
33	gsmMu7ammed/anythingllm-mcp Manage and operate AnythingLLM workspaces, chats, documents, and vectors...	22	Experimental	—	Python
34	fitchmultz/cloop Local-first loop/task and knowledge assistant with web UI, CLI, FastAPI,...	22	Experimental	—	Python
35	kyle122497/llamator-mcp-server 🚀 Automate LLM red teaming workflows with the MCP server for LLAMATOR,...	22	Experimental	—	Python
36	richard-luc/KiCAD-Schematic-Manipulation MCP server that enables AI agents to create, modify, and analyze KiCAD...	22	Experimental	—	Python
37	corpollc/corpo-mcp MCP server for AI agent entity formation — sandbox for Wyoming DAO LLC...	22	Experimental	—	Python
38	virbahu/mcp-sc-integration Model Context Protocol integration for supply chain AI agents	22	Experimental	—	Python
39	TECHKNOWMAD-LABS/techknowmad-mcp 8 MCP servers for the AI agent ecosystem.	22	Experimental	—	Python
40	vladimiracunadev-create/mcp-ollama-local MCP + Ollama local: FastAPI web con chat, tools MCP (sandbox) e historial SQLite.	22	Experimental	—	HTML
41	pblagoje/mcp-ollama-python Ollama MCP Server, let's you chat with your local LLM running on your local...	20	Experimental	1	Python
42	angrysky56/ollama-mcp-server Use fast-agent to use MCP tools with local LLM, API or Claude Desktop. WIP	19	Experimental	5	Python
43	jaspertvdm/RABEL 🧠 RABEL - MCP Server for AI-to-AI communication. I-Poll messaging, AINS...	19	Experimental	—	Python
44	aipartnerup/apcore-mcp Automatic MCP Server & OpenAI Tools Bridge for apcore.	17	Experimental	3	—
45	aiperceivable/apcore-mcp Automatic MCP Server & OpenAI Tools Bridge for apcore.	17	Experimental	3	—
46	arjunprabhulal/ai-boutique-assit-mcp-client Model Context Protocol (MCP) Client for Online Boutique AI Assistant GKE10...	16	Experimental	1	Python
47	geminixandroid/simple-mcp-ollama-server MCP server with ollama	16	Experimental	1	Python
48	aipartnerup/apcore-mcp-python Automatic MCP Server & OpenAI Tools Bridge for apcore.	15	Experimental	1	Python
49	lukasmki/llamacpp-mcp An MCP (Model Context Protocol) wrapper for running local LLMs using llama-cpp-python	15	Experimental	—	Python
50	aiperceivable/apcore-mcp-python Automatic MCP Server & OpenAI Tools Bridge for apcore.	15	Experimental	1	Python
51	CSGA-GLOBAL/cobol-bridge COBOL Bridge MCP Server - AI Governance for Legacy Mainframes. Connect 220B...	14	Experimental	—	HTML
52	krampus-nuggets/panopticon Integrate local LLMs into your codebase. Save on tokens/cost + Always...	14	Experimental	—	Python
53	riteshgharat/oange-cli Powerful multi-IDE automation and orchestration tool that connects AI agents...	14	Experimental	—	Python
54	AD-Archer/internal-ai-bridge-mcp A generic MCP and AI server that allows for a connection with an internal AI...	13	Experimental	2	Python
55	ParthaPRay/Ollama_MCP_Gradio This repo presents MCP server for localized Ollama using Gradio	13	Experimental	—	Python
56	angrysky56/hybrid-ai-mcp Bridges the "black box" problem by creating a formal, inspectable decision...	12	Experimental	1	Python
57	sandeepnmenon/py_bazel_mcp Integrate Bazel with AI coding assistants via the Model Context Protocol	12	Experimental	1	Python
58	nim444/mcp-ingest 🚧 This project is currently under development 🚧	11	Experimental	—	Python
59	salog0d/UrbanPlannerMCP Acts as the communication layer between the AI components and the FastAPI...	11	Experimental	—	Python
60	Vignesh010101/llamaindex-mcp Build your own Local MCP Client with LlamaIndex	11	Experimental	—	Jupyter Notebook
61	tivaliy/mcp-nlp MCP-NLP is a FastMCP application designed to provide NLP (Natural Language...	11	Experimental	—	Python
62	marc-shade/agi-mcp Status: Production Ready	11	Experimental	—	Python
63	nathishdev-netizen/MCP-Factory AI-powered platform that turns natural language into fully functional MCP...	11	Experimental	—	Python
64	marc-shade/coral-tpu-mcp Coral TPU MCP Server - Fast local ML inference for agentic systems	11	Experimental	—	Python
65	mo1998/NerA A native Arabic intelligence layer and MCP server providing dialect...	11	Experimental	—	Python
66	arjunprabhulal/ai-boutique-assit-mcp Model Context Protocol (MCP) Server for Online Boutique AI Assistant GKE10...	11	Experimental	—	Python

Comparisons in this category

mcp-client-for-ollama and zin-mcp-client (69 vs 37) mcp-client-for-ollama and mcp-llama3-client (69 vs 32) mcp-client-for-ollama and Local_MCP_Client (69 vs 31) zin-mcp-client and Local_MCP_Client (37 vs 31)