petals-infra/chat.petals.dev
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
This project offers a web-based chatbot and API endpoints for interacting with large language models like Llama 2. You input text prompts, and the system generates relevant text responses. It's designed for developers or businesses who want to integrate custom AI chatbot functionality into their own applications or workflows.
318 stars. No commits in the last 6 months.
Use this if you need to quickly set up a custom chatbot interface or integrate powerful text generation into your application using large language models, without managing the underlying model infrastructure yourself.
Not ideal if you're looking for an off-the-shelf end-user chatbot experience without any development or integration work.
Stars
318
Forks
79
Language
Python
License
—
Category
Last pushed
Apr 22, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/petals-infra/chat.petals.dev"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
TheR1D/shell_gpt
A command-line productivity tool powered by AI large language models like GPT-5, will help you...
Simatwa/python-tgpt
AI Chat in Terminal + Package + REST-API
aandrew-me/tgpt
AI Chatbots in terminal for free
AndraxDev/speak-gpt
Your personal voice assistant based on OpenAI ChatGPT.
GaiZhenbiao/ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with...