AaronFriel/fn-stream
Create interactive, powerful AI applications with streaming, structured responses from language models
This helps developers build interactive AI applications that deliver responses from large language models in a streaming, structured format. It takes raw, token-by-token output from an LLM and converts it into usable, structured data, allowing for real-time processing and display. Developers can use this to create responsive user interfaces for AI agents, chatbots, or code generation tools.
No commits in the last 6 months.
Use this if you are a developer building an AI application where you need to show users real-time, structured responses from a language model, such as live code generation or data extraction.
Not ideal if you primarily need to process entire, pre-defined JSON objects from an LLM rather than stream and parse them incrementally.
Stars
23
Forks
—
Language
TypeScript
License
—
Category
Last pushed
Jan 16, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/AaronFriel/fn-stream"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
lmstudio-ai/lmstudio-js
LM Studio TypeScript SDK
lmstudio-ai/lms
LM Studio CLI
samestrin/llm-interface
A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers,...
nbonamy/multi-llm-ts
A Typescript library to use LLM providers APIs in a unified way.
token-js/token.js
Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.