LLM Frameworks & Libraries LLM Tools

Frameworks, libraries, and toolkits for building, training, and integrating LLMs across various languages and environments. Does NOT include deployed applications, end-user tools, or domain-specific implementations (those belong in specialized categories like rag-applications or langchain-chatbot-applications).

There are 187 llm frameworks & libraries tools tracked. 7 score above 50 (established tier). The highest-rated is liguodongiot/llm-action at 63/100 with 23,504 stars. 3 of the top 10 are actively maintained.

Get all 187 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-frameworks-libraries&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 liguodongiot/llm-action

本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

63
Established
2 datawhalechina/self-llm

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程

62
Established
3 microsoft/LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

58
Established
4 theaniketgiri/create-llm

The fastest way to build and start training your own LLM. CLI tool that...

58
Established
5 AI-Planning/l2p

Library for LLM-driven action model acquisition via natural language

57
Established
6 StanfordSpezi/SpeziLLM

Large Language Model (LLM) module for the Spezi Ecosystem

51
Established
7 InternLM/InternLM

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

51
Established
8 ar-jan/llm-venice

LLM plugin for Venice AI

49
Emerging
9 NatLabRockies/elm

ELM is a collection of utilities to apply Large Language Models (LLMs) to...

47
Emerging
10 ashvardanian/TinySemVer

Tiny Semantic Versioning (SemVer) library with LLMs and GitHub CI, that...

46
Emerging
11 Vastai/VastModelZOO

VastModelZOO...

45
Emerging
12 baichuan-inc/Baichuan2

A series of large language models developed by Baichuan Intelligent Technology

45
Emerging
13 baichuan-inc/Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology

45
Emerging
14 MiniMax-AI/MiniMax-M2.1

MiniMax M2.1, a SOTA model for real-world dev & agents.

44
Emerging
15 hyperai/vllm-cn

vLLM Documentation in Chinese Simplified / vLLM 中文文档

44
Emerging
16 CLUEbenchmark/SuperCLUE

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

44
Emerging
17 Zjh-819/LLMDataHub

A quick guide (especially) for trending instruction finetuning datasets

44
Emerging
18 MiniMax-AI/MiniMax-M2

MiniMax-M2, a model built for Max coding & agentic workflows.

44
Emerging
19 Nerif-AI/Nerif

LLM-powered Python

43
Emerging
20 HCPLab-SYSU/Book-of-MLM

《多模态大模型:新一代人工智能技术范式》作者:刘阳,林倞

39
Emerging
21 Mr-Skeleton-Max/MathBrain

Research on Bionic and Efficient Neural Network Architectures

39
Emerging
22 gia-uh/lingo

A Python library for context engineering.

39
Emerging
23 MiuLab/Taiwan-LLM

Traditional Mandarin LLMs for Taiwan

39
Emerging
24 ContextLab/llm-stylometry

LLM-based approach for distinguishing the writings of different authors.

37
Emerging
25 mtkresearch/MR-Models

聯發創新基地(MediaTek Research)...

36
Emerging
26 attentionmech/mav

Model Activity Visualiser

36
Emerging
27 OpenSQZ/MegatronApp

Toolchain built around the Megatron-LM for Distributed Training

36
Emerging
28 cxcscmu/Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

36
Emerging
29 SteveKGYang/MentalLLaMA

This repository introduces MentaLLaMA, the first open-source instruction...

36
Emerging
30 wenge-research/YAYI2

YAYI 2 是中科闻歌研发的新一代开源大语言模型,采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2...

35
Emerging
31 manthanguptaa/real-world-llm-apps

curated collection of real world applications that use LLMs

35
Emerging
32 kleer001/Text_Loom

Network for procedural editing of text with LLMs

35
Emerging
33 inclusionAI/Ling

Ling is a MoE LLM provided and open-sourced by InclusionAI.

34
Emerging
34 FreedomIntelligence/BlenderLLM

BlenderLLM: A LLM specifically designed to generate CAD scripts based on...

33
Emerging
35 HIT-SCIR/Chinese-Mixtral-8x7B

中文Mixtral-8x7B(Chinese-Mixtral-8x7B)

33
Emerging
36 inclusionAI/Ling-V2

Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.

33
Emerging
37 hunch-app/declarai

A Pythonic integration for LLMs.

33
Emerging
38 Azure99/BlossomLM

A powerful, open-source large language model, including the training data.

33
Emerging
39 salesforce/xgen

Salesforce open-source LLMs with 8k sequence length.

33
Emerging
40 FareedKhan-dev/basiclingua-LLM-Based-NLP

LLM Based NLP Library.

33
Emerging
41 HIT-SCIR/huozi

活字通用大模型

32
Emerging
42 Yu-Yang-Li/StarWhisper

LLM for Astronomy[星语4.0]

32
Emerging
43 alphrc/lilm

Large language model fine-tuned to mimic LIHKG users' behavior

32
Emerging
44 phodal/aigc

《构筑大语言模型应用:应用开发与架构设计》一本关于 LLM...

32
Emerging
45 julep-ai/steadytext

Deterministic text generation and embeddings with zero configuration

32
Emerging
46 l294265421/my-llm

All about large language models

32
Emerging
47 mallahyari/llm-hub

A curated collection of interesting applications, repos, and tutorials using...

32
Emerging
48 mattmerrick/llmlogs

A blog dedicated to helping creators, developers, and curious minds...

31
Emerging
49 ACADLab/SPICEPilot

This repository hosts the information of SPICEPilot: a training free LLM...

31
Emerging
50 uiuing/varbook

适合中文程序员的变量命名助手,LLM+知识库,规范变量命名,定制化变量命名规则

31
Emerging
51 PennShenLab/MentalChat16K

A benchmark dataset designed to support the development and evaluation of...

30
Emerging
52 zhangzhengde0225/Xiwu

Xiwu: A Large Lanauge Model for High Energy Physics

30
Emerging
53 ahpxex/open-dictionary

The genuine open dictionary, grounded by Wikitionary and explained more with LLMs

30
Emerging
54 Remmie0/OpenFunsearch

Open Funsearch implementation of Google Deepmind's Funsearch

29
Experimental
55 yeasy/llm_internals

深入剖析大语言模型架构、原理到训练部署 | How LLM works, including Design, Architecture and...

28
Experimental
56 GURPREETKAURJETHRA/Perfect-LLM-Model-Finder

Perfect LLM Model Finder is a tool designed to simplify the overwhelming...

28
Experimental
57 pea3nut/awesome-llm-zh

大语言模型中文资源归总!

28
Experimental
58 intentee/llmops-handbook

Practical and advanced guide to LLMOps. It provides a solid understanding of...

28
Experimental
59 AragonerUA/SampoNLP

A corpus-free toolkit for morphological lexicon creation and tokenizer...

28
Experimental
60 HariomJangra/project-lumen

A 128M parameter language model built from scratch for learning how large...

27
Experimental
61 sshh12/llm_oracle

LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a...

27
Experimental
62 sec3-service/Owl-LM

Large Language Model for Blockchain

27
Experimental
63 githubnext/UpgrAIder

Upgrade deprecated/outdated code using LLMs and release notes

27
Experimental
64 top-on/llmask

A command-line tool for masking authorship of text, by changing the writing...

27
Experimental
65 patrick-tssn/LM-Research-Hub

Language Modeling Research Hub, a comprehensive compendium for enthusiasts...

27
Experimental
66 Jerryym/AICAD

LLM在CAD中的应用程序开发

27
Experimental
67 pstutz/syncodia

Bridging Large Language Models with Scala 3 Functions

26
Experimental
68 IvanaXu/CQMC

LLM + 中文文本匹配 Chinese Question Matching Corpus

26
Experimental
69 DrejcPesjak/scaling-monosemanticity-llama

Reproducing Scaling Monosemanticity: Extracting Interpretable Features from...

25
Experimental
70 Sharukesh3/LLM-for-hydrogen-storage

The LARGE LANGUAGE MODEL FOR HYDROGEN STORAGE project uses advanced natural...

24
Experimental
71 svilupp/LLMTextAnalysis.jl

Effortlessly uncover and label thematic insights in large document...

24
Experimental
72 erdogant/LLMlight

LLMlight is a lightweight Python library for running local language models...

24
Experimental
73 llmapi-io/llm-linker

:link: LLM links to everything !

24
Experimental
74 DrResh/LLM-Cheat-Sheets

LLM Based Learning Cheat sheets for quick reference

24
Experimental
75 edaaydinea/llm_mastery

Learn to master the latest in Large Language Models (LLMs) including...

24
Experimental
76 FlagAI-Open/Aquila2

The official repo of Aquila2 series proposed by BAAI, including pretrained &...

24
Experimental
77 LLMine/llmine_core

Your Platform for Text Mining through Configurable LLM Chains. Ideal for...

24
Experimental
78 steelonion/Monkeys-with-Novelwriters

use llm to write novel 使用大模型的小说写作框架

24
Experimental
79 D3soros/nanoAI-zoo

🧠 Explore lightweight AI models across CV, LLM, VLM, and Generative AI for...

24
Experimental
80 Kuberwastaken/MiniLMs

A research project focused on studying and implementing minimalist language...

24
Experimental
81 aryyyy01/minimind

🧠 Simplify your machine learning workflow with MiniMind, a collection of...

23
Experimental
82 Pro1943/NanoMind

A Small Language Model built from scratch in pure Python and PyTorch. Train...

23
Experimental
83 mac999/blender-llm-addin

Text-to-3D Model addin for Blender using Ollama and OpenAI GPT

23
Experimental
84 algunion/UniLM.jl

UniLM.jl: Currently a Julia interface for OpenAI's (+Azure) language models,...

23
Experimental
85 neerajtiwari360/understand_LLM

A comprehensive guide and tools for running large language models (LLMs) on...

23
Experimental
86 HySonLab/LANTERN

LANTERN: Leveraging Large Language Models And Transformer For Enhanced...

23
Experimental
87 piotrmaciejbednarski/pllum-cookbook

This repository contains example Jupyter notebooks demonstrating how to use...

23
Experimental
88 KCaverly/cog-models

A collection of cog models for use on Replicate

23
Experimental
89 adrianrob1/variational-learning-playground

A playground and experimental space for testing variational learning methods.

23
Experimental
90 mohrez86/pyllmut

A research-based LLM-driven mutant generator library for Python

22
Experimental
91 Neilblaze/LMPool

Personal hub of LM implementations, NLP experiments, and inference workflows 🛠️

22
Experimental
92 mehmandarov/llm-security-and-predictability

Demo code and examples for the talk "Taming the Chaos". It demonstrates...

22
Experimental
93 tsen1220/minimax-sdk

SDKs for MiniMax APIs — Text, Speech, Video, Image, Music & Files

22
Experimental
94 chukjosh/BibleLLM

A lightweight, PyTorch-based character-level Transformer Language Model...

22
Experimental
95 ZhaoDevHub/SeedLLM

Ultra-lightweight foundational LLM framework for beginners and teaching.

22
Experimental
96 TyrelM10/LLM-to-PDDL

Building domain knowledge specifically in PDDL from natural language...

22
Experimental
97 luciITby/OpenLabLM

🚀 Build your own LLM easily with OpenLabLM, a lightweight, hackable codebase...

22
Experimental
98 abhishekraok/wandering-light

A Python library for LLM tool call mastery through self play.

22
Experimental
99 branded12345/Geo-Llama

🌐 Enhance language understanding through geometric deep learning with...

22
Experimental
100 mrbadr1243/variational-learning-playground

Explore, test, and benchmark variational learning methods with an extensible...

22
Experimental
101 vahagn-madatyan/dgx-spark-lab

DGX Spark hands-on ML training lab — model training, fine-tuning, and...

22
Experimental
102 soenneker/soenneker.attributes.llms.properties

An attribute for describing properties to LLMs

22
Experimental
103 neomakes/eigen-llm

Decomposing large general AI into small, specialized intelligence.

22
Experimental
104 ristponex/awesome-minimax

🧠 Awesome MiniMax M2 Series — Track M2, M2.1, M2.5, M2.7 and the evolution...

22
Experimental
105 mapio/selma

Search Engines and Language Models Animations

22
Experimental
106 dpavlis/llm_feedback

A multi-user web application for testing and evaluating (own) LLM models...

22
Experimental
107 BobMcDear/llaf

LLMs in Futhark

22
Experimental
108 YEthYuan/mini-Llama2

Mini-LLaMA2: A Compact Implementation of LLaMA2

22
Experimental
109 laugustyniak/LLM-demo-2-production

The set of tools and examples for creating LLM-based solutions from demo to...

22
Experimental
110 Scr44gr/elelems

A very, very, very simple SLM. I'm just learning.

21
Experimental
111 Jagoul/BLEND

This repository contains the official implementation of BLEND, a novel...

20
Experimental
112 longyuewangdcu/GuoFeng-Webnovel

Multilingual Corpus of Web Fiction

20
Experimental
113 LiorGazit/llmpop

The library that lets you spin up any LLM in a unified command.

20
Experimental
114 hululuzhu/llm-primer

A primer on large language models (LLM) as of Jan 2023, with bonus ChatGPT topic

20
Experimental
115 gpavanb1/LLaMArch

Minimal, Building Blocks for Large Language Models!

20
Experimental
116 justinamiller/SmallMind

SmallMind is a production-ready, local language model inference engine built...

19
Experimental
117 ahmadghazinazer/forge-ml

End-to-end platform for LLM post-training. Dataset versioning, training...

19
Experimental
118 nercone-dev/zeta-llm

Fully Open-source LLM

19
Experimental
119 CYBIRD-D/How-to-Choose-your-LLM-Model-for-translation

This is a post for beginners to choose the LLM Models suit themselves to...

18
Experimental
120 caesarnine/llm-experiments

Playing around with LLMs

18
Experimental
121 shure-dev/logllm

Automatically extract ML experimental conditions from your Python scripts...

18
Experimental
122 bobazooba/wgpt

This repository features an example of how to utilize the xllm library....

18
Experimental
123 dhaval-vedra/lowmind

LowMind - Ultra-Lightweight Deep Learning Framework for Low-End Devices

17
Experimental
124 yezhengkai/LawGPT

An experimental project to fine-tune a LLM using ROC law-related content

17
Experimental
125 arcee-ai/arcee-python

The Arcee client for executing domain-adpated language model routines...

17
Experimental
126 FunnySaltyFish/bilibili_comments_crawl

基于 B 站评论区数据构建大语言模型训练用对话数据集

17
Experimental
127 Ashwin3919/OpenSLM

Plug-and-play experimentation platform for small language models (SLM). 8...

16
Experimental
128 yhzhu99/llm-mdt

Multiple large language models as a multidisciplinary team

16
Experimental
129 SharathHebbar/Model-Sharding

Sharding Large Language Models for loading them efficiently in lesser RAM

16
Experimental
130 machinelearningzuu/LLM-in-Production

Welcome to the "LLM in Production" repository! This project aims to provide...

15
Experimental
131 awab-ml/LLM-Compiler

LLM-Compiler is an architecture that improves LLM task execution by...

15
Experimental
132 InternLM/InternLM-Law

[COLING 2025] InternLM-Law: An Open Source Chinese Legal Large Language Model

15
Experimental
133 DNGros/lmwrapper_OLD

An object-oriented wrapper around language models. Moved to...

15
Experimental
134 zetavg/twlm

Taiwanese Mandarin LLM Project

15
Experimental
135 i-nahornyi/gatling-llm-demo

Example of testing an LLM with Gatling

15
Experimental
136 BenardKemp/6SigmaMindV3

6SigmaMind Model Comparison: SmolLM-1.7B vs Qwen-1.5B vs DeepSeek R1 — Which...

15
Experimental
137 Iro96/tinyllm

An LLM model with 10 million parameters was designed for research purposes.

15
Experimental
138 gameofdimension/seven8wen

大语言模型高效微调

14
Experimental
139 dharunkumars-hub/LLM-and-Chatbot

A Large Language Model (LLM) is a type of AI trained on massive datasets to...

14
Experimental
140 RapidAI/LLM-DOC

大模型研究院资料馆

14
Experimental
141 anthony-maio/Eve-0.5B-saber

Eve-3-SABER-0.5B: 0.5B parameter code + tool use model with novel...

14
Experimental
142 adimis-ai/Large-Language-Model-LLM-Wrapper-from-Scratch-using-Openai-models

The LLM (Language Model) Wrapper is a versatile tool designed to interact...

14
Experimental
143 KKenny0/LLMpedia

搜集和分享个人喜欢的大语言模型(LLM)相关资源的在线百科全书。涵盖 LLM 的基础知识、研究进展、技术应用、工具和最佳实践。

14
Experimental
144 yrvelez/auto_vignette

Toy example of how LLMs can be used to create survey experiments

14
Experimental
145 zhengbangbo/llm-timeline

A brief history of Large Language Models. From the launch of ChatGPT to the...

14
Experimental
146 zlown/MiniMax-M2.5

🤖 Empower AI applications with MiniMax-M2.5, a streamlined, efficient model...

14
Experimental
147 VanVan120/Malay-to-Code-LLM

A research project to fine-tune a Large Language Model (LLM) to generate...

14
Experimental
148 benthecoder/llms

llm playground

13
Experimental
149 quentinwendegass/tiny-llm

Research project for LLMs

13
Experimental
150 ejhusom/MELODI

Use local Large Language Models (LLMs) while monitoring energy usage.

13
Experimental
151 jhuapl-fomo/ralf

A lightweight library to support the development of applications using LLMs

13
Experimental
152 Xhst/ml-record-linkage

Unstructured Record Linkage using Siamese Networks and Large Language Models...

13
Experimental
153 groloch/LocalLlm

Drop-in and advanced solutions to experiment with open source LLM !

13
Experimental
154 BorjaOteroFerreira/IALab-Suite

Tool for test diferents large language models without code.

13
Experimental
155 JLX0/llm-automl

Automate machine learning tasks at the code level with LLMs and autoML |...

13
Experimental
156 TinyTalks/Butterfly

Butterfly: An Open NLP Research Project for Chinese Danmaku,B站弹幕NLP社区建设

13
Experimental
157 llmupdate/pages

LLMUpdate, 大模型周报 -- 每周大模型和AI的重要进展,跟进值得关注的技术进步、产品创新 https://llmupdate.com

13
Experimental
158 MikiTwenty/belso

Better LLMs Structured Outputs - A useful python package!

13
Experimental
159 keli-wen/AGI-Study

The blog, read report and code example for AGI/LLM related knowledge.

12
Experimental
160 viktorbezdek/definitive-llm-writing-style-guide

The Definitive Guide to LLM Writing Styles

12
Experimental
161 iakashpaul/Eastworld

Keeping Westworld alive via LLMs 🦾

12
Experimental
162 Isaac-To/Researcher

Extending LLMs to search online for resources!

12
Experimental
163 llmprogram/llmprogram

LLMProgram is a Python package that provides a structured and powerful way...

12
Experimental
164 csw314/Local-LLM

Local-LLM is a lightweight Python library for running open-source language...

12
Experimental
165 anto18671/lumenspark2

Lumenspark2 is the second-generation implementation of Lumenspark, a...

12
Experimental
166 ella0333/LLM-Scribe

LLM Scribe is a toolkit for creating handwritten datasets quickly and easily...

12
Experimental
167 LiguseCorp/rrrLLM-generator

Rare Refusal-Reply LLM generator. Aimed at generating a new model based on...

12
Experimental
168 shayanAthif/LLM-for-hydrogen-storage

The LARGE LANGUAGE MODEL FOR HYDROGEN STORAGE project uses advanced natural...

12
Experimental
169 z-aqib/CSE453_MLOps-Engineering-AI-Systems

MLOps and LLMOps course repository for IBA Karachi (Fall 2025), collecting...

12
Experimental
170 wguDataNinja/WGU-Reddit-Feedback-Analyzer

LLMs analyzing Reddit posts from WGU students to spot course-level issues....

11
Experimental
171 llmprogram/llmprogram-docs

This is the documentation for the llmprogram library

11
Experimental
172 0xnu/tipus-micro-llm

Character-level and token-based language models implemented in pure PyTorch.

11
Experimental
173 Praveen76/LLM-Projects-Archive

The "LLM Projects Archive" is a centralized GitHub repository, offering a...

11
Experimental
174 rtuszik/lma

Language Model Authentication

11
Experimental
175 kodlan/vLLM-ops-lab

vLLM Ops Lab

11
Experimental
176 matthew-potts/LLMs-MacroNews

Batch-processing system to support analysis of LLM assessments of macroeconomic news.

11
Experimental
177 XIXUM/nlx

this project is about natural language processing with a formal model

11
Experimental
178 turtacn/unimodel

UniModel:An open-source lightweight, efficient, and unified serving engine...

11
Experimental
179 VrianCao/InfoLLM

A repository that introduces content related to LLM in Chinese.

11
Experimental
180 BlocTheWorker/llm-modding-guide

A general guide for modders who want to use LLM to mod their favorite games

11
Experimental
181 SaPhyoThuHtet/llm-hub

Resources, and Pratical Codes (using llm, fine tuning llm, and training...

11
Experimental
182 smaranjitghose/liteLLM

Multi LLM Integration with LiteLLM and Ollama

11
Experimental
183 AstroQuantumphysicist/LMMpy

LLMpy is a package that allows to easily create advanced Large Language Models.

10
Experimental
184 0JCRG0/LLMOps-101

An open-source guide to LLMOps, blending theory and practice for deploying...

10
Experimental
185 KENTHD8mg/FLM

大语言模型技术基础之破晓

10
Experimental
186 aiworkspace/cangjie

Cangjie - Yet Another open-source LLM Building and Training Framework

10
Experimental
187 FromZeroToFanatic/LLM_Practical_Implementation_Demo2

大模型实战学习路线阶段2:大模型部署实战(手把手带你完成开源大模型的部署搭建)与实战

10
Experimental