Ruby LLM Frameworks LLM Tools

Frameworks and libraries for building LLM-powered applications in Ruby, including agents, chat interfaces, and AI-driven features. Does NOT include language ports, grammar specifications, or non-Ruby implementations.

There are 41 ruby llm frameworks tools tracked. 1 score above 70 (verified tier). The highest-rated is microsoft/multilspy at 71/100 with 548 stars and 76,966 monthly downloads. 1 of the top 10 are actively maintained.

Get all 41 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=ruby-llm-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	microsoft/multilspy multilspy is a lsp client library in Python intended to be used to build...	71	Verified	548	Python
2	mlc-ai/xgrammar Fast, Flexible and Portable Structured Generation	61	Established	1,581	C++
3	vicentereig/dspy.rb The Ruby framework for programming—rather than prompting—language models.	44	Emerging	208	Ruby
4	feenkcom/gt4llm A GT package for working with LLMs	43	Emerging	16	Smalltalk
5	frameIQ/pygaeb Python parser for GAEB DA XML construction data exchange files (v2.0–3.3)...	42	Emerging	5	Python
6	hyparam/hyllama llama.cpp gguf file parser for javascript	41	Emerging	50	JavaScript
7	Evref-BL/Pharo-LLMAPI Use LLM API from Pharo	38	Emerging	7	Smalltalk
8	llmrb/llm.rb Ruby toolkit for multiple Large Language Models (LLMs)	38	Emerging	106	Ruby
9	scientist-labs/ruby_llm-red_candle Support for local LLMs, running inside of your Ruby process for RubyLLM	37	Emerging	4	Ruby
10	antononcube/Raku-LLM-Functions Raku package for functions and function objects to access, interact, and...	36	Emerging	5	Raku
11	janeapp/riffer The all-in-one Ruby framework for building AI-powered applications and agents.	36	Emerging	6	Ruby
12	xybrid-ai/xybrid Run LLMs, ASR and TTS locally in your app (Rust core, iOS/Android/Flutter/Unity)	35	Emerging	57	Rust
13	trymirai/uzu-swift A high-performance inference engine for AI models	34	Emerging	52	Swift
14	trymirai/uzu-ts A high-performance inference engine for AI models	31	Emerging	8	TypeScript
15	mensfeld/pocketrb Pocket-sized Ruby AI agent framework / LLM assistant with multi-LLM support	29	Experimental	36	Ruby
16	KerfuffleV2/gguf-tools Some random tools for working with the GGUF file format	27	Experimental	31	Python
17	alpinebuster/arkime-docker-compose Deploy Arkime with GPU-accelerated Rust/Python parsers and custom plugins...	27	Experimental	2	Rust
18	crmne/ruby_llm-workshop Companion code for the "Building AI-Powered Apps with RubyLLM" workshop	26	Experimental	5	HTML
19	AlbanPerli/pygbnf A composable Python DSL for building GBNF grammars compatible with llama.cpp.	25	Experimental	4	Python
20	miko-ai-org/llmbatching An openAI / LLM API wrapper that simplifies the batching API to reduce costs by 50%	25	Experimental	19	TypeScript
21	sanjaybip/llm-clients A list of LLM clients that can be used to interact with a proprietary or...	23	Experimental	11	—
22	antononcube/Raku-DSL-Examples Raku data package with examples of DSL commands translations to programming...	22	Experimental	3	Raku
23	moeki0/baran Text Splitter for Large Language Model (LLM) datasets.	22	Experimental	19	Ruby
24	LegionIO/legion-llm LLM integration for LegionIO - chat, embeddings, tool use, and agents via ruby_llm	22	Experimental	—	Ruby
25	antononcube/WL-DSLExamples-paclet Wolfram Language paclet with Domain Specific Language (DSL) examples...	21	Experimental	—	Wolfram Language
26	antononcube/Raku-ML-FindTextualAnswer Raku package for finding sub-strings in a given text that appear to answer...	21	Experimental	—	Raku
27	gbaptista/mistral-ai A Ruby gem for interacting with Mistral AI's large language models.	20	Experimental	30	Ruby
28	antononcube/Raku-ML-NLPTemplateEngine Raku package that provides NLP template engine for making different kinds of...	20	Experimental	1	Raku
29	mariochavez/llm_server Rack API application for Llama.cpp	19	Experimental	39	Ruby
30	nicieja/lammy An LLM library for Ruby	18	Experimental	39	Ruby
31	vicentereig/a2ui-rails A2UI for Rails - LLM-driven UI generation with DSPy.rb and Turbo Streams	16	Experimental	13	Ruby
32	temphia/fuzzylogic LLM + temphia	16	Experimental	3	Go
33	rodneylab/local-ai-llm-playground Experiments running offline LLMs in Python and Rust locally using Ollama and...	16	Experimental	1	Rust
34	jd174/InfraLLM InfraLLM is an framework to allow LLMs to (somewhat) safely interact with SSH clients	16	Experimental	2	C#
35	hiremav/spectre Spectre is a Ruby gem that makes it easy to AI-enable your Ruby on Rails application.	14	Experimental	28	Ruby
36	e-kayrakli/llm.chpl A Chapel port of llm.c	13	Experimental	6	Chapel
37	IohannesArnold/xml_gbnf A GBNF grammar of XML for use in llama.cpp	13	Experimental	6	—
38	mariochavez/llm_client Ruby client to connect to LLM Server.	12	Experimental	4	Ruby
39	antononcube/Raku-LLM-Containerization Docker file, Cro Web API, and CLIs for packaging LLM functionalities.	11	Experimental	—	Raku
40	promptjoy/promptjoy-ruby Ruby library for PromptJoy	11	Experimental	2	Ruby
41	antononcube/Raku-Text-SubParsers Raku package for extracting and processing of interpret-able sub-strings in texts.	10	Experimental	1	Raku

Comparisons in this category

llm.rb and pocketrb (38 vs 29)