Leniolabs/promptwizard
Prompt Wizard is a package for evaluating custom prompts using various evaluation methods. It allows you to provide your own prompts or generate them automatically and then obtain the results in a JSON file. You can also use the library for your Python projects.
This tool helps anyone working with AI models to fine-tune and compare different prompts. You provide your prompt ideas and example questions, and it returns a detailed evaluation, showing which prompts perform best for your specific task. It's designed for prompt engineers, AI trainers, or product managers who need to ensure their AI behaves as expected.
No commits in the last 6 months.
Use this if you need to systematically test and improve your AI prompts, or automatically generate new ones, to get the most accurate and desirable responses from your models.
Not ideal if you're not working with large language models, or if you don't need a structured approach to prompt evaluation and iteration.
Stars
13
Forks
3
Language
Python
License
MIT
Category
Last pushed
Nov 29, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/Leniolabs/promptwizard"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
promptslab/Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured...
masci/banks
LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and...
character-ai/prompt-poet
Streamlines and simplifies prompt design for both developers and non-technical users with a low...
promplate/partial-json-parser
Parse partial JSON generated by LLM
Hunyuan-PromptEnhancer/PromptEnhancer
PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions...