SuperBruceJia/promptcraft
PromptCraft is a prompt perturbation toolkit from the character, word, and sentence levels for prompt robustness analysis. PyPI Package: pypi.org/project/promptcraft
This toolkit helps you test how robust your AI models are by slightly changing your text inputs in various ways. You provide a sentence or prompt, and it generates many altered versions, simulating common real-world errors or stylistic changes. This is used by AI developers and researchers to evaluate the reliability and resilience of their natural language processing models.
No commits in the last 6 months. Available on PyPI.
Use this if you need to systematically perturb text data at the character, word, or sentence level to test the stability and performance of your language models.
Not ideal if you're looking for a tool to improve the quality or readability of your own writing, as its purpose is to introduce variations, not refine content.
Stars
21
Forks
1
Language
Python
License
MIT
Category
Last pushed
Jan 03, 2024
Commits (30d)
0
Dependencies
14
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/SuperBruceJia/promptcraft"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
promptslab/Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured...
masci/banks
LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and...
character-ai/prompt-poet
Streamlines and simplifies prompt design for both developers and non-technical users with a low...
promplate/partial-json-parser
Parse partial JSON generated by LLM
Hunyuan-PromptEnhancer/PromptEnhancer
PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions...