LLM JSON Streaming LLM Tools

Tools for parsing, extracting, and handling JSON from LLM output streams in real-time, including partial/malformed JSON recovery and incremental parsing. Does NOT include general JSON libraries, XML parsing tools, or SSE/streaming infrastructure unrelated to structured output extraction.

There are 46 llm json streaming tools tracked. 1 score above 70 (verified tier). The highest-rated is mangiucugna/json_repair at 74/100 with 4,585 stars. 1 of the top 10 are actively maintained.

Get all 46 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-json-streaming&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	mangiucugna/json_repair A python module to repair invalid JSON from LLMs	74	Verified	4,585	Python
2	antfu/shiki-stream Streaming highlighting with Shiki. Useful for highlighting text streams like...	59	Established	572	TypeScript
3	iw4p/partialjson +1M Downloads! Repair invalid LLM JSON, commonly used to parse the output of...	54	Established	99	Python
4	yokingma/fetch-sse An easy API for making Event Source requests, with all the features of...	54	Established	29	TypeScript
5	kaptinlin/jsonrepair A high-performance Golang library for easily repairing invalid JSON...	47	Emerging	94	Go
6	HAibiiin/json-repair Repair JSON! A Java library for fixing JSON anomalies generated by LLMs.	43	Emerging	94	Java
7	xtao-org/jsonhilo Fast lossless JSON parse event streaming, in JavaScript.	42	Emerging	45	JavaScript
8	samhvw8/partial-xml-stream-parser partial-xml-stream-parser This parser is designed to handle XML data that...	40	Emerging	6	TypeScript
9	thijse/JsonRepairSharp Repair invalid JSON documents in C#	38	Emerging	22	C#
10	FunnySaltyFish/partial-json-parser-kmp 🔧 Kotlin Multiplatform library for parsing and repairing partial/incomplete...	35	Emerging	7	Kotlin
11	nuxdie/json-like-parse JavaScript npm module that finds JSON-like text within a string and then...	35	Emerging	22	JavaScript
12	teamchong/vectorjson O(n) streaming JSON parser for LLM tool calls. Agents act sooner, abort bad...	35	Emerging	14	JavaScript
13	samuelfaj/distill Distill large CLI outputs into small answers for LLMs and save tokens!	34	Emerging	262	TypeScript
14	a-r-d/ai-json-safe-parse Depedency free safe fuzzy JSON parsing for semi malformed LLM responses	33	Emerging	2	TypeScript
15	aotakeda/ai-json-fixer A simple JSON parser specifically designed to handle malformed JSON output...	33	Emerging	26	TypeScript
16	alaa-eddine/tokenloom a lightweight TypeScript/Javascript library for progressively parsing...	30	Emerging	7	TypeScript
17	st3w4r/json-that CLI dev tool to transfrom any raw text into JSON	30	Emerging	2	HTML
18	deepankarm/godantic Validation, JSON & OpenAPI Schema for Go with Union support. Inspired by...	30	Emerging	25	Go
19	anusarati/json-schema-builder A powerful, visual GUI for developers to create and manage JSON Schemas,...	29	Experimental	5	JavaScript
20	st3w4r/openai-partial-stream Turn a stream of token into a parsable JSON object as soon as possible....	28	Experimental	122	HTML
21	chu2bard/eventpipe Server-sent events streaming library for LLM responses	27	Experimental	16	TypeScript
22	theluk/llm-patcher Generate & Stream Patches of Changes and Save Tokens and Shortens Response Time	27	Experimental	31	TypeScript
23	ComsIndeed/llm-json-stream-dart A reactive, character-by-character JSON state machine with a clean,...	26	Experimental	11	Dart
24	sammwyy/graceful-json A graceful JSON parser and serializer with fallback handling.	25	Experimental	25	TypeScript
25	yingkitw/anyrepair generic repair for common format that work with AI	24	Experimental	2	Rust
26	kyle-mirich/repairjson Rust-backed repair of malformed JSON for LLM-style outputs	24	Experimental	1	Rust
27	JacksonKearl/gjp-4-gpt JSON parser for streaming objects live from an LLM's output	23	Experimental	36	TypeScript
28	xDarkicex/llm-json-extract High-Assurance JSON Extraction & Recovery for LLM Output	23	Experimental	1	Perl
29	gr-b/jsonltui A fast TUI application (with optional webui) to visually navigate and...	22	Experimental	15	HTML
30	majiayu000/jsonrepair-rs Repair broken JSON in Rust — fix quotes, commas, comments, truncation, and...	22	Experimental	—	Rust
31	carpcarp/gsap Go Schema-Aligned Parser — parse messy LLM JSON into typed structs with...	22	Experimental	—	Go
32	tterrasson/extrait Structured JSON extraction from LLMs with validation, repair, and streaming.	22	Experimental	—	TypeScript
33	nitin-k8s/cleanllm Extract and validate JSON from messy LLM responses.	21	Experimental	—	Python
34	RockeyDon/PartialBracket Parse incomplete JSON(or other struct) String	21	Experimental	—	Rust
35	rpriya29/jemini-json 🛠️ Convert JSON files into a structured file system effortlessly with...	21	Experimental	—	Lua
36	jordicor/ai-json-cleanroom Automatically extracts JSON from markdown/text, repairs common AI mistakes,...	21	Experimental	2	Python
37	AzoraAHAI2001/llm-formatter 🤖 Format your codebase for Large Language Models effortlessly, respecting...	21	Experimental	—	PHP
38	tsmx/json-tools Analyze, transform and obfuscate JSON objects and convert them to a...	21	Experimental	—	JavaScript
39	alikiki/saxamll A no-frills online XML parser specifically designed for LLM applications.	21	Experimental	6	TypeScript
40	BHznJNs/xml-patcher A LLM API proxy that can patches the wrong XML tool call instructions.	21	Experimental	8	TypeScript
41	usrbinsam/ijson A JSON parser for incomplete JSON streams, especially for streaming LLM...	21	Experimental	—	Go
42	AspadaX/surfing A Rust library for parsing JSON objects from text streams.	19	Experimental	2	Rust
43	selfagency/llm-stream-parser 🤖 Composable parsers and stream processing utilities for LLM responses.	19	Experimental	—	TypeScript
44	jy02140251/openai-stream-parser Zero-dependency OpenAI streaming response parser for SSE events. TypeScript...	15	Experimental	2	TypeScript
45	qdxiao/llmjsonrepair llmjsonrepair 是一个专门修复大语言模型（LLM）输出 JSON 格式错误的 Go 语言库。当 ChatGPT、Claude 等 AI...	14	Experimental	11	Go
46	fareaster/doctor-json Edit JSON and JSONC files while preserving whitespace, comments, and...	13	Experimental	—	—

Comparisons in this category

json_repair and partialjson (74 vs 54) json_repair and jsonrepair (74 vs 47) json_repair and json-repair (74 vs 43) json_repair and ai-json-fixer (74 vs 33) ai-json-safe-parse and ai-json-fixer (33 vs 33)