Forward-Operators/prr
prr - command-line LLM prompt runner
This tool helps developers efficiently test and compare prompts across various Large Language Models (LLMs), whether they are hosted locally or via APIs. Developers input their prompts and desired LLM configurations, and the tool outputs responses, along with performance metrics like response times and token counts. It's designed for developers working on applications powered by LLMs who need to quickly iterate on prompt engineering.
No commits in the last 6 months.
Use this if you are an AI developer regularly designing and refining prompts for various LLMs and need a fast way to compare their performance and outputs.
Not ideal if you are an end-user looking for a no-code solution to interact with LLMs, as this tool requires technical setup and command-line usage.
Stars
26
Forks
1
Language
Python
License
MIT
Category
Last pushed
Jul 28, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Forward-Operators/prr"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
rafalzawadzki/spellbook-forge
✨ Make your LLM prompts executable and version controlled. ✨
Dicklesworthstone/source_to_prompt_tui
TUI for combining source code files into LLM-ready prompts: tree explorer, syntax preview, token...
SoraFlows/SoraFlows
The most powerful and modular Sora WebUI, api and backend with OpenAI's Sora Model. Collecting...
yokoffing/ChatGPT-Prompts
ChatGPT and Bing AI prompt curation
swaymm7/Open-Source-Prompt-Library
Here is where I store all my useful prompts