LLM Framework Abstractions AI Agents

Core libraries and frameworks that provide unified abstractions, capability mapping, and foundational patterns for building LLM-based agents and applications. Does NOT include domain-specific agents, deployment platforms, or end-user applications—focuses on developer-facing toolkits and architectural standards.

There are 139 llm framework abstractions agents tracked. 2 score above 70 (verified tier). The highest-rated is InfinitiBit/graphbit at 88/100 with 524 stars and 903 monthly downloads. 2 of the top 10 are actively maintained.

Get all 139 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=agents&subcategory=llm-framework-abstractions&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Agent	Score	Tier	Stars	Language
1	InfinitiBit/graphbit GraphBit is the world’s first enterprise-grade Agentic AI framework, built...	88	Verified	524	Rust
2	autogluon/autogluon-assistant Multi-Agent System Powered by LLMs for End-to-end Multimodal ML Automation	71	Verified	257	Python
3	samholt/L2MAC 🚀 The LLM Automatic Computer Framework: L2MAC	59	Established	146	Python
4	pguso/agents-from-scratch Build AI agents from first principles using a local LLM - no frameworks, no...	58	Established	593	Python
5	wjayesh/mahilo mahilo: Multi-Agent Human-in-the-Loop Framework is a flexible framework for...	57	Established	470	Python
6	pguso/ai-agents-from-scratch Demystify AI agents by building them yourself. Local LLMs, no black boxes,...	55	Established	3,283	JavaScript
7	mnfst/awesome-free-llm-apis Permanent Free LLM API List (API Keys) 😎🔑	54	Established	1,056	—
8	sigoden/llm-functions Easily create LLM tools and agents using plain Bash/JavaScript/Python functions.	52	Established	717	Shell
9	christianheine/jorel LLMs made easy: Multiple providers, images, documents, tools, and agents in...	47	Emerging	5	TypeScript
10	PathOnAIOrg/LiteWebAgent [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications	45	Emerging	146	Python
11	MVPandey/DTS 🌳 MCTS-inspired parallel beam search for conversation optimization....	45	Emerging	35	Python
12	askmanu/acorn LLM framework for long running agents	43	Emerging	7	Python
13	PathOnAIOrg/LiteMultiAgent The Library for LLM-based multi-agent applications	43	Emerging	102	Python
14	AgnostiqHQ/multi-agent-llm Lean implementation of various multi-agent LLM methods, including Iteration...	42	Emerging	128	Python
15	i365dev/llm_agent An abstraction library for building domain-specific intelligent agents based...	42	Emerging	27	Elixir
16	NKAI-Decision-Team/LLM-PySC2 LLM-PySC2 is NKAI Decision Team and NUDT Decision Team's Python component of...	41	Emerging	152	Python
17	Pravko-Solutions/FlashLearn Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and...	40	Emerging	608	Python
18	ARPAHLS/rooms A secure, local-first Python framework for orchestrating complex multi-agent...	40	Emerging	8	Python
19	rubra-ai/rubra Open Weight, tool-calling LLMs	40	Emerging	155	Makefile
20	kenshiro-o/nagato-ai Simple cross-LLM AI Agent library	39	Emerging	118	Python
21	Rovanta/rmodel rModel is a framework for building LLM applications with agentic workflow	39	Emerging	66	Go
22	pengshuang/Awesome-Agent-Projects Fun LLM Agent Projects I Designed & Built	39	Emerging	52	Python
23	diegovelilla/FreeThinker FreeThinker is an AI agent that uses free-of-charge API open source LLMs in...	38	Emerging	85	Python
24	aniketmaurya/Agents Build Agentic workflows with function calling using open LLMs	38	Emerging	28	Python
25	ShunsukeHayashi/swml-agent Physics-based coding agent. Minimizing action in Omega-space. S =...	37	Emerging	3	Python
26	AlbanPerli/Noema-Declarative-AI A declarative way to control LLMs.	35	Emerging	80	Python
27	turboline-ai/tsln-python Time Series Lean Notation for python, it is designed to maximize the token...	35	Emerging	4	Python
28	bin123apple/MACM [NeurIPS 2024] MACM: Utilizing a Multi-Agent System for Condition Mining in...	35	Emerging	92	Python
29	jtdowney/starlet An LLM interaction library that makes you feel like a star	34	Emerging	1	Gleam
30	Das-rebel/tmlpd-skill TMLPD v3.0 - Production-Grade AI Agent Platform with Self-Healing Parallel...	34	Emerging	3	Python
31	Aquiles-ai/Ishikawa-Toolkit Extensible framework for creating and managing LLM function calling.	34	Emerging	1	TypeScript
32	balakhonoff/ai42z ai42z is an innovative framework designed to transform Large Language Models...	33	Emerging	37	Python
33	Jeomon/Meta-Agent-with-More-Agents The purpose of the "Meta Agent with More Agents" project is to dynamically...	33	Emerging	43	Jupyter Notebook
34	AliNajafi1998/ComStream In this project, we implemented a topic detection system on Twitter. This...	32	Emerging	26	Python
35	kjannette/kongruity_ kongruity leverages LLMs and cohesion scoring to transform unstructured...	31	Emerging	184	JavaScript
36	RamboRogers/cyber-inference Cyber-Inference is a web GUI management tool for running OpenAI-compatible...	31	Emerging	10	Python
37	Shrest4647/awesome-llm-app-ideas A curative list of app ideas that you can implement using the Large Language Models.	31	Emerging	12	—
38	iBz-04/raya llm agent that controls your computer	30	Emerging	27	Python
39	voidborne-d/lambda-lang Λ — Minimal agent-to-agent communication language	30	Emerging	5	Python
40	RAIL-Suite/RAIL Remote Agent Invocation Layer	30	Emerging	13	C++
41	mozilla/fm4se-lab A collaborative repository for experiments and research on Foundation Models...	28	Experimental	2	Python
42	aritraroy24/the-fullerene-factory Repository of Team "The Fullerene Factory" for 2025 LLM Hackathon for...	28	Experimental	1	Python
43	ayushchaware08/multi_agent_system multi-agent AI system that intelligently routes user queries to specialized...	27	Experimental	1	Python
44	GlyphyAI/liteswarm Lightweight Agent Framework for building AI apps with any LLM	26	Experimental	5	Python
45	Yutarop/turtlebot3_agent Control TurtleBot3 with natural language using LLMs	26	Experimental	19	Python
46	Masao-Taketani/AI-Scientist-with-Local-LLMs The AI Scientist backed up by local LLMs	26	Experimental	6	TeX
47	SOCIALPINE/ergodic-pipeline Multi-agent AI pipeline that transforms random noise into emergent research...	26	Experimental	7	Python
48	zmzubraj/APOLLO_Gov_Proposal_System APOLLO is a comprehensive governance automation framework that leverages...	25	Experimental	—	Python
49	acblabs/multi_llm A cost-aware, multi-LLM routing agent using Gemini as the default and...	25	Experimental	3	Python
50	Yutarop/turtlesim_agent Draw with LLMs in ROS2 TurtleSim	25	Experimental	28	Python
51	saadsh15/ai_council A terminal-based multi-agent AI research platform that orchestrates local...	24	Experimental	—	Python
52	ArneJanning/local-skills-agent Self-extending AI agent system running on local Ollama - creates its own...	24	Experimental	11	Python
53	NullRabbitLabs/llm-gateway Multi-provider LLM gateway with automatic fallback and cost tracking. Single...	24	Experimental	2	Python
54	okhmat-anton/babber Agents server for home LLM	23	Experimental	1	Python
55	okhmat-anton/ai-agents-server Agents server for home LLM	23	Experimental	1	Python
56	contactjccoaching-wq/spinal-loop Bio-inspired multi-agent orchestration — 4 neuromuscular mechanisms for...	23	Experimental	1	Python
57	MahmoudHussienMohamed/Agentic-Network-Monitoring Agentic Network Monitoring: An autonomous multi-agent SOC system powered by...	23	Experimental	6	Python
58	yhlchat-dev/ai-agent-system Modular AI agent with memory, task scheduling, and tool integration capabilities.	23	Experimental	1	Python
59	Evidion-AI/EvidionAI Autonomous multi-agent AI research system	23	Experimental	1	Python
60	humbertogontijo/bullmq-ai-agent Scalable AI agent orchestration with BullMQ and LangChain. Define goals and...	22	Experimental	—	TypeScript
61	Antonio-Tresol/agents A very simple agent framework for LLM-based agents research, as...	22	Experimental	—	Python
62	mdShakil2004/LLM-projects-Store LLM Projects Store , production-ready LLM applications built using RAG, AI...	22	Experimental	—	Python
63	ellmos-ai/rinnsal Lightweight LLM agent infrastructure: Memory, Connectors, Automation....	22	Experimental	—	Python
64	LoremHug/A-0 A₀-stabilized generation regime for LLMs. A₀ does not select paths. It...	22	Experimental	—	—
65	thematic-blacksea501/llm-council-master-free Deliver robust AI model failover chains with free-tier APIs for scalable,...	22	Experimental	—	Python
66	muhammadhussain-2009/Open-Source-LLM-Projects Locally Hosted LLM Projects. AI agent projects included as well	22	Experimental	—	Python
67	techravish/cleverlabs-llm-suite A curated collection of LLM-powered applications, AI agents, and GenAI...	22	Experimental	—	Jupyter Notebook
68	ENTITY107/rlmgw 🔄 Explore Recursive Language Models (RLMs) to enhance natural language...	22	Experimental	—	Python
69	DandaAkhilReddy/Amazing_LLM_Apps Curated collection of LLM apps built with RAG, AI Agents, Multi-agent Teams,...	22	Experimental	—	Python
70	marrakechinmorocco/sktk Simplify building Python LLM agents with a unified API, guardrails,...	22	Experimental	—	Python
71	B-A-M-N/SynapticLlamas Distributed Multi-Agent AI Orchestration with Ollama - Advanced...	22	Experimental	3	Python
72	eason-tien/arcmind 🧠 OODA-based autonomous AI Agent — multi-provider LLM routing, 63 skills,...	22	Experimental	—	Python
73	ronit111/showntell Frame extraction toolkit for LLM agents. Transcripts capture what was said;...	22	Experimental	—	Python
74	Devgoodcode/ideal-ai One Connector to Rule Them All. The ultimate Open Source Python LLM...	21	Experimental	—	Python
75	The-Swarm-Corporation/DPO-MCTS-ToT-Training This module implements a post-training mechanism that allows a language...	21	Experimental	8	Python
76	BharkaviPM/local-search-ai-agent Fully local autonomous AI research agent using Ollama with tool-based web...	21	Experimental	—	Python
77	Maryam-Nasseri/MoA-local A simplified agentic workflow process based on the Mixture of Agents (MoA)...	20	Experimental	6	Python
78	bowen-upenn/Multi-Agent-VQA [CVPR 2024 CVinW] Multi-Agent VQA: Exploring Multi-Agent Foundation Models...	20	Experimental	20	Python
79	baekenough/clau-doom LLM-orchestrated multi-agent DOOM AI: RAG experience accumulation + DOE...	20	Experimental	1	Python
80	hexanomicon/lychd An LLM-animated daemon bound to Systemd. Forges intelligent agents using...	20	Experimental	1	Python
81	jiannanya/llm_structured Parse messy LLM output into trustworthy, validated structured data — with...	20	Experimental	1	C++
82	jstilb/compound-ai-system Multi-model router with intelligent routing, cost tracking, quality...	19	Experimental	—	Python
83	minkaungmon430/ollama-multi-agent-roleplay Simple yet powerful multi-agent framework using Ollama and local LLMs....	19	Experimental	—	Python
84	melo-maniac-29/orbital-agent-framework Local-first agent framework for building tool-using LLM workflows with LangGraph	19	Experimental	—	Python
85	hunterooc/bootstrap-basil Training a small language model from random weights, using curriculum-driven...	19	Experimental	—	Python
86	CoRAL-ASU/MAMMQA (IJCNLP-AACL 2025) MAMMQA: Rethinking Information Synthesis in Multimodal...	19	Experimental	—	Python
87	m3dcodie/LLM-Capability-Framework-LCF Precision-Matched Intelligence. The LLM Capability Framework (LCF) is a...	19	Experimental	—	—
88	Hemanth2890/Autonomous-ML-Agent Imbalance-aware Multi-Agent AutoML system with cross-validated macro-F1...	19	Experimental	—	Python
89	yashk1103/ArcSys Multi-Agent System for developing Backend Architectures	19	Experimental	—	Python
90	eliacharfe/llm-projects Applied LLM engineering experiments including RAG, vector search, LangChain...	19	Experimental	—	Python
91	hunyadi/function_tool Universal wrapper for Python functions to be used with LLM function calling	19	Experimental	—	Python
92	Lay4U/build-your-own-ai-agent 12 practical projects to master AI agents from scratch. No frameworks, no...	19	Experimental	—	Python
93	devXjitin/autourgos-llmkit Autourgos LLMKit is a lightweight toolkit that unifies access to multiple...	19	Experimental	—	Python
94	Seraphiel102/sovereign-dev-team 9-agent AI development team running 100% locally with Ollama	19	Experimental	—	Python
95	alo-genesis/ALO-RKA-CIS A design framework for controlling LLMs via Abstract Language Objects (ALO)...	19	Experimental	—	—
96	happydasch/llm_advisory Modular framework for building topic-specific advisors powered by large...	18	Experimental	4	Python
97	TommyOh0428/Multiagent-Bot A Multiagent Discord bot that utilize Large Language Model (LLM) and hosted...	17	Experimental	2	Python
98	T-Sunm/VMARC-QA Official implementation of 'A knowledge-based Multi-agent approach for...	16	Experimental	9	Jupyter Notebook
99	richstokes/multi-llama 🧠🦙 Multi-agent local LLM orchestrator, powered by ollama	16	Experimental	1	Python
100	Octaaaaa/agentic-ai-framework Framework for building multi-agent AI systems with LangGraph orchestration	16	Experimental	1	Python
101	muthuks2020/reasona AI Agent Orchestration Framework Context engineering, multi-agent...	16	Experimental	1	Python
102	maiglesi/llmx LLMX - A token-efficient protocol for inter-LLM communication. Enables...	15	Experimental	—	Shell
103	louislin520/tianji-decision-engine Deterministic time-based stochastic signal API for AI Agents. Inject...	15	Experimental	—	Python
104	0xhappydev/openai-compatible-llm-server Unified on-device multimodal inference for MLX and GGUF-based LLMs/VLMs.	15	Experimental	—	Python
105	ndjstn/tinyllm A neural network of LLMs - self-improving multi-agent system using small...	15	Experimental	—	Python
106	SJ9VRF/Multi-Agent-LLM Multi-agent LLM project using LlamaIndex for document-specific QA,...	15	Experimental	2	Python
107	yangyh-2025/moral-realism 大语言模型驱动的基于阎学通的道义现实主义理论的国际关系主体基建模（ABM）研究平台。 LLM-Driven Agent-Based Modeling...	15	Experimental	1	Python
108	Mohamed-samy2/AutoLLMOps-Pipeline This repository implements an end-to-end pipeline to collect domain-specific...	15	Experimental	—	Python
109	BarathKV/VectorRoute A Simple Vector embedding based routing standard/policy for LLM Tools and...	14	Experimental	—	Python
110	Diomandeee/cognitive-twin User pattern learning with trajectory-aware DPO training for conversational AI	14	Experimental	—	Python
111	ritheesh-dev/Autonomous-Tool-Calling-Agent Autonomous AI agent built from scratch using Ollama + Mistral — dynamic tool...	14	Experimental	—	Python
112	xkiwilabs/llm-inference-hub A reproducible LLM inference stack built on vLLM + LiteLLM, designed for...	14	Experimental	—	Shell
113	pulkitpareek18/mvm2 Multi-LLM Math Verification System — Solves math using 5 AI models...	14	Experimental	—	Python
114	Aisuko/secure_llm Accompanying repository for the paper “Secure, low-cost LLM support chatbots...	14	Experimental	4	Python
115	stable-reasoning/ai4materials Enhancing the reasoning of LLMs in materials discovery. MSc project at I-X,...	13	Experimental	—	Jupyter Notebook
116	hadirsa/spring-data-llm-adapter A Spring Boot library that extracts metadata from JPA entities (@Entity,...	13	Experimental	2	Kotlin
117	ranfysvalle02/vanilla-agents This repository provides a flexible and customizable implementation of an...	12	Experimental	12	Python
118	phucsystem/llm-project-proposal-generation-agent LLM agent for automated project proposal generation	12	Experimental	1	—
119	gradrix/dendrite 🧠 Self-organizing AI agent with dendrite spawning - decomposes complex goals...	11	Experimental	—	Python
120	pradeepiyer/ray-agent AI Agents for Ray: ask ray questions, analyze for resource requrements,...	11	Experimental	—	Python
121	Darakhsh1999/ollama-agents Agentic framework implemented exclusively around Ollama models.	11	Experimental	—	Python
122	christalphilip/llm-agents Multi-agent LLM system where agents answer questions and a critic evaluates...	11	Experimental	—	Python
123	0DevDutt0/multi-agent-ai-orchestration-system Production-ready multi-agent AI orchestration system using LangChain that...	11	Experimental	—	Python
124	Masao-Taketani/LocalAgentLaboratory This repository accommodates local LLMs for Agent Laboratory, with which you...	11	Experimental	2	Python
125	shotafujie/entaku ローカルLLMによる円卓会議 \| Multi-persona AI roundtable discussion system using local LLMs	11	Experimental	—	Python
126	sohaibzafar701/RoboLinguist Production-ready system enabling intuitive robot fleet control through...	11	Experimental	—	Python
127	Biodyn-AI/mi-workbench Autonomous multi-agent platform for mechanistic interpretability research	11	Experimental	—	Python
128	DhruvrajSinhZala24/internship-task-multiagent A modular multi-agent AI system that classifies and routes documents (Email,...	11	Experimental	—	Python
129	Dasha0205/llm_projects Collection of hands-on mini-projects from the LLM Engineering: Master AI,...	11	Experimental	—	Python
130	kishoretvk/jsonAI jsonAI, a open-source Python library designed to address the common...	11	Experimental	—	Python
131	Bala-vikram8/LLM-Router Smart LLM routing that sends each query to the cheapest model that can...	11	Experimental	—	Python
132	yeukfei02/multi-llm-agent multi-llm-agent	11	Experimental	—	Python
133	m3mentomor1/Input-based-LLM-Routing-Agent A dynamic input-based LLM routing AI-agent built with n8n. It selects the...	11	Experimental	—	—
134	LiteObject/multi-agent-research A multi-agent research framework leveraging LLMs to explore collaborative AI...	11	Experimental	—	Python
135	BesmirQerosi/local-ai-agent A fully autonomous, local AI Agent built with React, FastAPI, LangGraph &...	11	Experimental	—	Python
136	janneesa/sena SENA is a synchronous state-machine AI agent project built with Python and Ollama.	11	Experimental	—	Python
137	fvilmos/AI_ReAct_agent Implements a Reasoning and Acting AI agent with local LLM and tools usage in Python.	10	Experimental	1	Python
138	UTSAVS26/DungeonLM DungeonLM is a language model-powered agent designed for navigating and...	10	Experimental	3	Python
139	mhattingpete/llm-agents A repository for easy setup of LLM powered autonomous agents	10	Experimental	1	Python

Comparisons in this category

agents-from-scratch and ai-agents-from-scratch (58 vs 55) autogluon-assistant and jorel (71 vs 47)