st3w4r/openai-partial-stream
Turn a stream of token into a parsable JSON object as soon as possible. Enable Streaming UI for AI app based on LLM.
This project helps developers build AI applications that feel fast and responsive. It takes fragmented pieces of information coming from an AI model (like OpenAI's) and assembles them into a usable data structure as quickly as possible. The result is that users of AI applications get to see partial, but complete, information much sooner, making their experience more engaging. This is for developers creating AI-powered user interfaces.
122 stars. No commits in the last 6 months.
Use this if you are a developer building an AI application and want to provide a real-time, streaming user experience rather than making users wait for the full AI response.
Not ideal if your application doesn't require real-time updates and can wait for the AI to return a complete response before displaying anything.
Stars
122
Forks
1
Language
HTML
License
MIT
Category
Last pushed
Jun 14, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/st3w4r/openai-partial-stream"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mangiucugna/json_repair
A python module to repair invalid JSON from LLMs
antfu/shiki-stream
Streaming highlighting with Shiki. Useful for highlighting text streams like LLM outputs.
yokingma/fetch-sse
An easy API for making Event Source requests, with all the features of fetch(), Supports...
iw4p/partialjson
+1M Downloads! Repair invalid LLM JSON, commonly used to parse the output of LLMs — Parsing...
kaptinlin/jsonrepair
A high-performance Golang library for easily repairing invalid JSON documents. Designed to fix...