Go LLM Frameworks LLM Tools

Go language frameworks and libraries for building LLM-powered applications, agents, and orchestration systems. Does NOT include LLM provider SDKs, language-agnostic agent frameworks, or application-specific implementations in other languages.

There are 80 go llm frameworks tools tracked. 3 score above 50 (established tier). The highest-rated is cloudwego/eino at 65/100 with 10,009 stars. 3 of the top 10 are actively maintained.

Get all 80 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=go-llm-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	cloudwego/eino The ultimate LLM/AI application development framework in Go.	65	Established	10,009	Go
2	xyproto/algernon Small self-contained pure-Go web server with Lua, Teal, Markdown, Ollama,...	63	Established	2,993	Go
3	instill-ai/instill-core 🔮 Instill Core is a full-stack AI infrastructure tool for data, model and...	53	Established	2,307	Python
4	gocnn/candy Minimalist ML framework for Go.	47	Emerging	456	Go
5	Shuffle/Singul Singul: Connect to your favorite services with a Singul line of code.	46	Emerging	25	Go
6	voocel/litellm LiteLLM for Go, the easiest way to write LLM-based programs in Go	45	Emerging	31	Go
7	showntop/llmack The GoLang Fullstack LLM Framework(llm intergration、cache、route、rag、ai...	41	Emerging	17	Go
8	0x4D31/galah Galah: An LLM-powered web honeypot.	39	Emerging	638	Go
9	modfin/bellman Golang lib for LLM APIs, ChatGPT, Gemini and Anthropic	39	Emerging	67	Go
10	plexusone/omnillm Multi-provider abstraction for LLMs including Anthropic, Bedrock, Gemini,...	37	Emerging	3	Go
11	maximhq/maxim-go SDK to integrate Maxim in your Go app.	36	Emerging	7	Go
12	turboline-ai/turbostream Analyze your realtime streaming data with LLM	34	Emerging	16	Go
13	FrenchMajesty/consistent-classifier Go package for creating consistent labels for a large dataset from an...	34	Emerging	63	Go
14	gotoailab/llmhub A golang library that unify all the llm into one interface API	33	Emerging	50	Go
15	bomfather/minefield Graphing SBOM's Fast.	31	Emerging	732	Go
16	tri2820/imply Open-source news site	31	Emerging	60	Go
17	svilupp/StreamCallbacks.jl Unified streaming interfaces for LLMs across various API providers. No more...	30	Emerging	2	Julia
18	instill-ai/deprecated-model ⚗️ Instill Model contains components for AI model orchestration	30	Emerging	20	Makefile
19	instill-ai/deprecated-core 🔮 Instill Core contains components for supporting Instill VDP and Instill Model	29	Experimental	13	Makefile
20	natexcvi/go-llm A framework for building LLM based agents and integrating them into larger...	29	Experimental	158	Go
21	ahr-i/ai-artist An AI Artist application utilizing LLM and Stable Diffusion.	27	Experimental	4	Go
22	Daniel-Sogbey/llm_log_pipeline Containerized Go service that uses LLMs (e.g., LLaMA 3.1 Instruct) to...	26	Experimental	3	Go
23	pardnchiu/cim-prototype LLM with Cognitive Imperfect Memory system	26	Experimental	6	Go
24	thiggle/api Structured LLM APIs	25	Experimental	156	MDX
25	x2d7/interlude Stream-first LLM library for Go	25	Experimental	3	Go
26	primalmotion/simplai A Go toolbox for building powerful LLM based application	24	Experimental	3	Go
27	pali-mem/pali Main Pali memory platform repository.	23	Experimental	1	Go
28	om308185/fo 🎺 Function calling utilities Go library based on Go 1.18+ Generics (Go2 like...	23	Experimental	1	Go
29	morphy76/lang-actor lang-actor is a golang framework, based on the actor model, to build LLM applications	23	Experimental	1	Go
30	voluminor/openwebui-ollama-proxy A proxy server written entirely in Go (with no external dependencies) that...	23	Experimental	1	Go
31	turboline-ai/tsln-golang Time Series Lean Notation Implementation for Go lang	23	Experimental	6	Go
32	joekariuki/sandgrouse Compress LLM API traffic for developers on metered connections.	23	Experimental	1	Go
33	slashbase/layerengine Simple AI generated code running engine based on LLMs & Lua written in Golang	23	Experimental	1	Go
34	ssbuild/aigc_serving aigc_serving lightweight and efficient Language service model reasoning	22	Experimental	24	Python
35	flexigpt/llmtools-go LLM Tool implementations for Golang	22	Experimental	—	Go
36	chicogong/stream-relay-go A lightweight Go streaming relay for LLM/TTS APIs with production-grade...	22	Experimental	—	Go
37	ammarlodhi255/self-healing-LLM-pipeline This repo contains the code written primarily in Golang for a self-healing...	22	Experimental	1	Go
38	dariubs/goAI A simple, modern, and reliable Go library for interacting with multiple LLM providers	22	Experimental	31	Go
39	hungpdn/llmgo LLM framework written in Go.	22	Experimental	—	Go
40	bds421/rho-llm-tutorial Progressive tutorials for the rho/llm Go library	22	Experimental	—	Go
41	hegner123/terse-tools Go library providing 18 builtin tools and provider adapters (Anthropic,...	22	Experimental	—	Go
42	bds421/rho-llm Multi-provider LLM client for Go. Streaming, tool use, extended thinking,...	22	Experimental	—	Go
43	zoobz-io/zyn Type-safe LLM orchestration for Go	22	Experimental	—	Go
44	zoobz-io/cogito LLM-powered reasoning chains with semantic memory for Go	22	Experimental	—	Go
45	mikyk10/phosphor AI image pipeline microservice — chain LLM calls, Lua scripts, and headless...	22	Experimental	—	Go
46	AmanPriyanshu/API-LLM-Hub A static-page vanilla-js interface for various LLM APIs (OpenAI, Claude,...	21	Experimental	8	HTML
47	konterfai-bot/konterfai Mirror repository for https://codeberg.org/konterfai/konterfai/ All...	21	Experimental	2	Go
48	mutablelogic/go-llama Go bindings for llama.cpp, an LLM inference engine	21	Experimental	2	Go
49	holysoles/bot-wrangler-traefik-plugin A Traefik Middleware Plugin that helps you wrangle those pesky LLM data...	20	Experimental	12	Go
50	chai2010/llmgo-book :books: Go和大语言模型编程	20	Experimental	44	Go
51	JoshPattman/jpf A Batteries-Included Framework to Build Scalable AI Apps	20	Experimental	1	Go
52	RealAlexandreAI/io-sankey 🧶 Framework for IO mapping and validation across heterogeneous data.	20	Experimental	1	Go
53	lucasjlepore/fit-analyzer Production-grade Go library for FIT workout analysis and lossless LLM-ready exports	19	Experimental	—	Go
54	fixdot/llm-seeker Automatically discover OpenAI-compatible local LLM endpoints	19	Experimental	—	Go
55	uriel-flame-of-god/LOSS LLM Output Sanitization Specification	19	Experimental	—	Go
56	thecxx/openllm A lightweight Go library for connecting OpenAI, Claude, and Gemini with...	19	Experimental	—	Go
57	JosemyDuarte/GoEvalsQAs Iterative LLM evaluation pipeline in Go example	19	Experimental	—	Go
58	aktagon/llmkit Go library providing a unified interface for LLM providers (OpenAI,...	19	Experimental	—	Go
59	alparslanyilmaaz/llmstreamer Go library for building real-time AI chat applications with streaming responses	18	Experimental	3	Go
60	petrgazarov/salami Infrastructure as Natural Language	17	Experimental	46	Go
61	Babbili/go-llm-app using `gollm` to integrate Large Language Models into Go application and add...	16	Experimental	9	Go
62	Conceptual-Machines/grammar-school A multi-language framework for building tiny LLM-friendly DSLs	16	Experimental	1	Python
63	qcgm1978/Sabaki-llm 利用 KataGo 的专业围棋分析能力和 LLM 的自然语言理解与解释能力，为用户提供既专业又易于理解的围棋分析结果	16	Experimental	1	JavaScript
64	mattjoyce/ductile Lightweight integration engine for small-scale automation.	16	Experimental	2	Go
65	vasilisp/lingograph Minimalistic low-boilerplate framework for LLM pipelines	16	Experimental	1	Go
66	donyaie/decision-llm-engine Production-ready Go service that turns unstructured decision questions into...	15	Experimental	1	Go
67	joeychilson/websurfer An API designed to help LLMs surf the web.	15	Experimental	—	Go
68	FrenchMajesty/turbo-run A Go package to maximize throughput of API requests to LLM cloud providers.	15	Experimental	—	Go
69	course-go/delegato LLM Prompt Forwarding Service	15	Experimental	—	Go
70	mlziade/zllm A Golang/Fiber implementation of a LLM API running Ollama locally	15	Experimental	—	Go
71	carlRondoni/llm-agent-go Interference Gateway for a local LLM agent	15	Experimental	1	Go
72	RamboRogers/cyberai WebUI for OpenAI, Ollama and Anthropic	14	Experimental	18	Go
73	gobenpark/gothought A lightweight, intuitive library for building LLM-powered applications in Go	14	Experimental	3	Go
74	cmitsakis/llm-api simple HTTP API for LLMs	13	Experimental	6	Go
75	cckalen/intellichunk Go Based Lightweight RAG / LLM Tool with CLI + API	12	Experimental	14	Go
76	AdityaPatange1/llm-classifier-go A general-purpose LLM classifier written in Go. ✨	12	Experimental	3	Go
77	nchapman/lleme The easy way to find, run, and manage local LLMs.	12	Experimental	1	Go
78	LLM-Tests-Checker/Common-Backend Monolith backend for LLM Tests Checker	11	Experimental	2	Go
79	Vitruves/llm-client A Go Tool to Infer from LLM servers	11	Experimental	—	Go
80	peterhellberg/llm Package llm implements a very small subset of the langchain project in Go.	10	Experimental	1	Go

Comparisons in this category

instill-core and deprecated-model (53 vs 30) instill-core and deprecated-core (53 vs 29) llmack and go-llm (41 vs 29) deprecated-model and deprecated-core (30 vs 29)