pors/langchain-chat-websockets
LangChain LLM chat with streaming response over websockets
This project provides a ready-to-use framework for building conversational AI applications that can deliver responses in real-time. It takes user queries as input and streams back AI-generated text, making interactions feel more dynamic and immediate. Developers and IT professionals can use this to integrate advanced chat functionalities into their web applications.
No commits in the last 6 months.
Use this if you need to quickly set up a chat interface that uses large language models and streams responses to users as they are generated, rather than waiting for a full reply.
Not ideal if you are looking for a pre-built chat application with a user interface, as this project focuses on the backend infrastructure for streaming LLM responses.
Stars
97
Forks
9
Language
HTML
License
Apache-2.0
Category
Last pushed
Nov 30, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/pors/langchain-chat-websockets"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Chainlit/chainlit
Build Conversational AI in minutes ⚡️
FullStackWithLawrence/aws-openai
Example ChatGPT chatbots using Langchain and OpenAI
mfmezger/conversational-agent-langchain
FastAPI Backend for a Conversational Agent using Cohere, (Azure) OpenAI, Langchain & Langgraph...
kvncampos/nautobot-ai-ops
Nautobot AI Plugin - Large Language Models (LLM), Model Context Protocol (MCP), Middleware and...
haseeb-heaven/langchain-coder
Web Application that can generate code and fix bugs and run using various LLM's (GPT,Gemini,PALM)