alan-turing-institute/prompto
An open source library for asynchronous querying of LLM endpoints
This is a tool for developers who are building applications that use Large Language Models (LLMs). It helps you test LLMs efficiently by sending many prompts to various LLM APIs like OpenAI, Anthropic, or Gemini at the same time. You provide your test prompts and parameters in a simple file (like JSONL or CSV), and it outputs the LLM responses for analysis and evaluation.
No commits in the last 6 months.
Use this if you are a developer or researcher running experiments with many prompts across multiple LLM models and APIs, and you need to process these requests quickly and in parallel to maximize API rate limits.
Not ideal if you are an end-user looking for a no-code solution or a non-technical person who doesn't work with Python libraries and API integrations.
Stars
36
Forks
2
Language
Python
License
MIT
Category
Last pushed
Jul 18, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/alan-turing-institute/prompto"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
vtuber-plan/langport
Langport is a language model inference service
ariannamethod/molequla
molequla.ai. live ecology of GPT organisms
ictnlp/Stream-Omni
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports...
ashleykleynhans/text-generation-docker
Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models with...