LLM JSON Streaming LLM Tools

Tools for parsing, extracting, and handling JSON from LLM output streams in real-time, including partial/malformed JSON recovery and incremental parsing. Does NOT include general JSON libraries, XML parsing tools, or SSE/streaming infrastructure unrelated to structured output extraction.

There are 51 llm json streaming tools tracked. 1 score above 70 (verified tier). The highest-rated is mangiucugna/json_repair at 87/100 with 4,585 stars and 16,557,243 monthly downloads. 1 of the top 10 are actively maintained.

Get all 51 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-json-streaming&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	mangiucugna/json_repair A python module to repair invalid JSON from LLMs	87	Verified	4,585	Python
2	antfu/shiki-stream Streaming highlighting with Shiki. Useful for highlighting text streams like...	56	Established	572	TypeScript
3	yokingma/fetch-sse An easy API for making Event Source requests, with all the features of...	47	Emerging	29	TypeScript
4	iw4p/partialjson +1M Downloads! Repair invalid LLM JSON, commonly used to parse the output of...	47	Emerging	99	Python
5	kaptinlin/jsonrepair A high-performance Golang library for easily repairing invalid JSON...	40	Emerging	94	Go
6	a-r-d/ai-json-safe-parse Depedency free safe fuzzy JSON parsing for semi malformed LLM responses	39	Emerging	2	TypeScript
7	OpenAF/oafp Command-line tool that takes an input, usually a data structure (e.g. json),...	37	Emerging	4	JavaScript
8	HAibiiin/json-repair Repair JSON! A Java library for fixing JSON anomalies generated by LLMs.	36	Emerging	94	Java
9	teamchong/vectorjson O(n) streaming JSON parser for LLM tool calls. Agents act sooner, abort bad...	36	Emerging	14	JavaScript
10	samuelfaj/distill Distill large CLI outputs into small answers for LLMs and save tokens!	35	Emerging	262	TypeScript
11	xtao-org/jsonhilo Fast lossless JSON parse event streaming, in JavaScript.	35	Emerging	45	JavaScript
12	aotakeda/ai-json-fixer A simple JSON parser specifically designed to handle malformed JSON output...	35	Emerging	26	TypeScript
13	samhvw8/partial-xml-stream-parser partial-xml-stream-parser This parser is designed to handle XML data that...	34	Emerging	6	TypeScript
14	kyle-mirich/repairjson Rust-backed repair of malformed JSON for LLM-style outputs	31	Emerging	1	Rust
15	thijse/JsonRepairSharp Repair invalid JSON documents in C#	31	Emerging	22	C#
16	alaa-eddine/tokenloom a lightweight TypeScript/Javascript library for progressively parsing...	29	Experimental	7	TypeScript
17	deepankarm/godantic Validation, JSON & OpenAPI Schema for Go with Union support. Inspired by...	29	Experimental	25	Go
18	WiegerWolf/json-like-parse JavaScript npm module that finds JSON-like text within a string and then...	28	Experimental	22	JavaScript
19	FunnySaltyFish/partial-json-parser-kmp 🔧 Kotlin Multiplatform library for parsing and repairing partial/incomplete...	28	Experimental	7	Kotlin
20	chu2bard/eventpipe Server-sent events streaming library for LLM responses	25	Experimental	16	TypeScript
21	TwistingTwists/json_partial json_parser for LLM outputs -> it fixes the malformed json and produces correct json	23	Experimental	6	Rust
22	anusarati/json-schema-builder A powerful, visual GUI for developers to create and manage JSON Schemas,...	23	Experimental	5	JavaScript
23	xDarkicex/llm-json-extract High-Assurance JSON Extraction & Recovery for LLM Output	23	Experimental	1	Perl
24	st3w4r/json-that CLI dev tool to transfrom any raw text into JSON	23	Experimental	2	HTML
25	AzoraAHAI2001/llm-formatter 🤖 Format your codebase for Large Language Models effortlessly, respecting...	22	Experimental	—	PHP
26	RockeyDon/PartialBracket Parse incomplete JSON(or other struct) String	22	Experimental	—	Rust
27	tsmx/json-tools Analyze, transform and obfuscate JSON objects and convert them to a...	22	Experimental	—	JavaScript
28	Loaila1680/parse-sse 🌐 Parse Server-Sent Events seamlessly with this lightweight and...	22	Experimental	—	JavaScript
29	sammwyy/graceful-json A graceful JSON parser and serializer with fallback handling.	22	Experimental	25	TypeScript
30	majiayu000/jsonrepair-rs Repair broken JSON in Rust — fix quotes, commas, comments, truncation, and...	22	Experimental	—	Rust
31	rpriya29/jemini-json 🛠️ Convert JSON files into a structured file system effortlessly with...	22	Experimental	—	Lua
32	selfagency/llm-stream-parser 🤖 Composable parsers and stream processing utilities for LLM responses.	22	Experimental	—	TypeScript
33	tterrasson/extrait Structured JSON extraction from LLMs with validation, repair, and streaming.	22	Experimental	—	TypeScript
34	carpcarp/gsap Go Schema-Aligned Parser — parse messy LLM JSON into typed structs with...	22	Experimental	—	Go
35	Wiseair-srl/json-to-office Generate professional .docx and .pptx files from JSON definitions	22	Experimental	—	TypeScript
36	nlink-jp/json-filter A command-line tool for robust JSON extraction, validation, and repair,...	22	Experimental	—	Go
37	st3w4r/openai-partial-stream Turn a stream of token into a parsable JSON object as soon as possible....	21	Experimental	122	HTML
38	ComsIndeed/llm-json-stream-dart A reactive, character-by-character JSON state machine with a clean,...	20	Experimental	11	Dart
39	yingkitw/anyrepair generic repair for common format that work with AI	20	Experimental	2	Rust
40	theluk/llm-patcher Generate & Stream Patches of Changes and Save Tokens and Shortens Response Time	20	Experimental	31	TypeScript
41	nitin-k8s/cleanllm Extract and validate JSON from messy LLM responses.	19	Experimental	—	Python
42	usrbinsam/ijson A JSON parser for incomplete JSON streams, especially for streaming LLM...	19	Experimental	—	Go
43	jordicor/ai-json-cleanroom Automatically extracts JSON from markdown/text, repairs common AI mistakes,...	17	Experimental	2	Python
44	JacksonKearl/gjp-4-gpt JSON parser for streaming objects live from an LLM's output	16	Experimental	36	TypeScript
45	BHznJNs/xml-patcher A LLM API proxy that can patches the wrong XML tool call instructions.	15	Experimental	8	TypeScript
46	gr-b/jsonltui A fast TUI application (with optional webui) to visually navigate and...	15	Experimental	15	HTML
47	alikiki/saxamll A no-frills online XML parser specifically designed for LLM applications.	14	Experimental	6	TypeScript
48	fareaster/doctor-json Edit JSON and JSONC files while preserving whitespace, comments, and...	14	Experimental	—	—
49	jy02140251/openai-stream-parser Zero-dependency OpenAI streaming response parser for SSE events. TypeScript...	13	Experimental	2	TypeScript
50	AspadaX/surfing A Rust library for parsing JSON objects from text streams.	13	Experimental	2	Rust
51	magifd2/json-filter A command-line tool for robust JSON extraction, validation, and repair,...	11	Experimental	—	Go

Comparisons in this category

json_repair and partialjson (87 vs 47) json_repair and jsonrepair (87 vs 40) json_repair and json-repair (87 vs 36) json_repair and ai-json-fixer (87 vs 35) json_repair and repairjson (87 vs 31) ai-json-safe-parse and ai-json-fixer (39 vs 35)