hegelai/prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

64
/ 100
Established

This tool helps AI developers and engineers efficiently test and compare different large language models (LLMs) and vector databases. You input your prompts and desired model parameters, and it provides a clear visualization of how different configurations perform. This allows you to quickly evaluate and choose the best setup for your specific AI application.

3,026 stars. Available on PyPI.

Use this if you are developing AI applications and need to systematically test and compare the performance of various LLMs or vector databases with different prompts and settings.

Not ideal if you are an end-user simply looking to interact with an LLM without needing to perform comparative testing or detailed performance evaluation.

AI development LLM evaluation prompt engineering vector database testing model comparison
Maintenance 10 / 25
Adoption 10 / 25
Maturity 25 / 25
Community 19 / 25

How are scores calculated?

Stars

3,026

Forks

254

Language

Python

License

Apache-2.0

Last pushed

Feb 11, 2026

Commits (30d)

0

Dependencies

9

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/hegelai/prompttools"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.