Mavenoid/prompt-hyperopt
Improve prompts for e.g. GPT3 and GPT-J using templates and hyperparameter optimization.
This helps people who work with Large Language Models (LLMs) to automatically improve how well their prompts work. You provide a few examples of what you want the LLM to generate and a few ways you think the prompt could be phrased, and this tool finds the best-performing prompt for your task. It's for anyone who needs to make LLMs give more reliable and accurate results without endless manual tweaking.
No commits in the last 6 months. Available on PyPI.
Use this if you are trying to get more consistent and accurate outputs from large language models for specific tasks, and you're tired of manually testing different prompt variations.
Not ideal if you have extensive resources for fine-tuning models on large datasets, as dedicated fine-tuning approaches typically yield superior results in those scenarios.
Stars
42
Forks
3
Language
Python
License
MIT
Category
Last pushed
Jan 06, 2023
Commits (30d)
0
Dependencies
9
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/Mavenoid/prompt-hyperopt"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI....
bigscience-workshop/promptsource
Toolkit for creating, sharing and using natural language prompts.
dair-ai/Prompt-Engineering-Guide
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering,...
thunlp/OpenPrompt
An Open-Source Framework for Prompt-Learning.
promptfoo/promptfoo-action
The GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming,...